[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:34:50 dist-test-slave-csg5 krb5kdc[8183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:34:50 dist-test-slave-csg5 krb5kdc[8183](info): set up 2 sockets
Aug 07 00:34:50 dist-test-slave-csg5 krb5kdc[8183](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 00:34:51.983899 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.898s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:34:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:34:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:34:52.123034 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44829
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44829
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:52.212590 8196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:52.212867 8196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:52.212894 8196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:52.214268 8196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:34:52.214329 8196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:52.214344 8196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:52.214358 8196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:34:52.214372 8196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:34:52.216573 8196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:52.216934 8196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:52.217286 8196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:52.224524 8202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:52.224490 8201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:52.224817 8204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:52.225390 8196 server_base.cc:1034] running on GCE node
I20260807 00:34:52.225800 8196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:52.226189 8196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:52.227523 8196 hybrid_clock.cc:648] HybridClock initialized: now 1786062892227491 us; error 102 us; skew 500 ppm
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:52.230706 8196 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:34:52.231178 8196 webserver.cc:460] Webserver started at http://127.7.252.62:44603/ using document root <none> and password file <none>
I20260807 00:34:52.231436 8196 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:52.231485 8196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:52.231635 8196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:52.233085 8196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "c02a68de5c384e8e9d7dc4d42fb84c45"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "0cf9c8055735331e26609142f50948f5"
server_key_iv: "3537abcd24b415c9391a119004f160e9"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.233798 8196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "c02a68de5c384e8e9d7dc4d42fb84c45"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "0cf9c8055735331e26609142f50948f5"
server_key_iv: "3537abcd24b415c9391a119004f160e9"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.235606 8196 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 00:34:52.236718 8211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.237056 8196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:52.237293 8196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "c02a68de5c384e8e9d7dc4d42fb84c45"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "0cf9c8055735331e26609142f50948f5"
server_key_iv: "3537abcd24b415c9391a119004f160e9"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.237401 8196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:52.247772 8196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:52.250754 8196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:52.250957 8196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:52.255467 8196 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44829
I20260807 00:34:52.255524 8268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44829 every 8 connection(s)
I20260807 00:34:52.255941 8196 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:34:52.257030 8269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:52.259645 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8196
I20260807 00:34:52.259845 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:34:52.259977 8269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45: Bootstrap starting.
I20260807 00:34:52.260604 8176 external_mini_cluster.cc:1428] Setting key 26d3e22f7d1f19340c4abb68df2362df
I20260807 00:34:52.260697 8269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:52.261175 8269 log.cc:824] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:52.262157 8269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45: No bootstrap required, opened a new log
I20260807 00:34:52.264290 8269 raft_consensus.cc:348] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44829 } }
I20260807 00:34:52.264546 8269 raft_consensus.cc:374] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:52.264627 8269 raft_consensus.cc:729] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c02a68de5c384e8e9d7dc4d42fb84c45, State: Initialized, Role: FOLLOWER
I20260807 00:34:52.264813 8269 consensus_queue.cc:260] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44829 } }
I20260807 00:34:52.264931 8269 raft_consensus.cc:388] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:34:52.264982 8269 raft_consensus.cc:482] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:34:52.265062 8269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:52.266124 8269 raft_consensus.cc:504] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44829 } }
I20260807 00:34:52.266265 8269 leader_election.cc:302] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c02a68de5c384e8e9d7dc4d42fb84c45; no voters:
I20260807 00:34:52.266497 8269 leader_election.cc:288] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:34:52.266558 8274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:52.266805 8274 raft_consensus.cc:686] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [term 1 LEADER]: Becoming Leader. State: Replica: c02a68de5c384e8e9d7dc4d42fb84c45, State: Running, Role: LEADER
I20260807 00:34:52.266865 8269 sys_catalog.cc:564] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:34:52.266911 8274 consensus_queue.cc:237] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44829 } }
I20260807 00:34:52.267302 8274 sys_catalog.cc:455] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c02a68de5c384e8e9d7dc4d42fb84c45. Latest consensus state: current_term: 1 leader_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44829 } } }
I20260807 00:34:52.267400 8274 sys_catalog.cc:458] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:52.267314 8275 sys_catalog.cc:455] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c02a68de5c384e8e9d7dc4d42fb84c45" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44829 } } }
I20260807 00:34:52.267613 8281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:34:52.268169 8281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:34:52.267632 8275 sys_catalog.cc:458] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:52.270248 8281 catalog_manager.cc:1347] Generated new cluster ID: ac98d9ab1264403783be309a3d97f66e
I20260807 00:34:52.270305 8281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:52.281585 8273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.261698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58368 (local address 127.7.252.62:44829)
0807 00:34:52.262151 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:52.262160 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:52.262203 (+ 43us) server_negotiation.cc:407] Connection header received
0807 00:34:52.264293 (+ 2090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:52.264303 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:52.264372 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:52.264608 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:52.266705 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.268216 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.269946 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.270560 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.270640 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.275586 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:52.275591 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:52.275592 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:52.275605 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:52.278755 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.279417 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.279420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.279421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.279627 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.280099 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.280100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.280100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.280438 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:52.280685 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:52.281005 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 00:34:52.281155 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":103,"threads_started":1}
I20260807 00:34:52.294606 8281 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:34:52.295567 8281 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:34:52.304414 8281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c02a68de5c384e8e9d7dc4d42fb84c45: Generated new TSK 0
I20260807 00:34:52.304771 8281 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:34:52.343703 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44829
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:52.467741 8296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:52.467976 8296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:52.468005 8296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:52.469647 8296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:52.469719 8296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:52.469762 8296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:34:52.471756 8296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44829
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:52.472047 8296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:52.472347 8296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:52.478863 8303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:52.478854 8302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:52.478946 8305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:52.479323 8296 server_base.cc:1034] running on GCE node
I20260807 00:34:52.479595 8296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:52.479910 8296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:52.481120 8296 hybrid_clock.cc:648] HybridClock initialized: now 1786062892481107 us; error 53 us; skew 500 ppm
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:52.484129 8296 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:34:52.484673 8296 webserver.cc:460] Webserver started at http://127.7.252.1:42211/ using document root <none> and password file <none>
I20260807 00:34:52.484905 8296 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:52.484972 8296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:52.485121 8296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:52.486259 8296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "e2e8a5e4d26042f494d88ef3554ac9d4"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "5424fefa73bd9ee00c064e433613240d"
server_key_iv: "b99dac0198e8cdef6d60b61352eb36e2"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.486701 8296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "e2e8a5e4d26042f494d88ef3554ac9d4"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "5424fefa73bd9ee00c064e433613240d"
server_key_iv: "b99dac0198e8cdef6d60b61352eb36e2"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.488276 8296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:52.489176 8312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.489521 8296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:52.489660 8296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "e2e8a5e4d26042f494d88ef3554ac9d4"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "5424fefa73bd9ee00c064e433613240d"
server_key_iv: "b99dac0198e8cdef6d60b61352eb36e2"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.489753 8296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:52.505926 8296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:52.508563 8296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:52.508750 8296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:52.509025 8296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:34:52.509387 8296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:52.509442 8296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.509481 8296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:52.509507 8296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.519110 8296 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:38267
I20260807 00:34:52.519224 8433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:38267 every 8 connection(s)
I20260807 00:34:52.519660 8296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:34:52.521051 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8296
I20260807 00:34:52.521165 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:34:52.521450 8176 external_mini_cluster.cc:1428] Setting key 7e0ed4d05997b4ca262c64691c390e27
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:52.532491 8273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.520661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:47401 (local address 127.7.252.62:44829)
0807 00:34:52.520709 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:52.520711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:52.521156 (+ 445us) server_negotiation.cc:407] Connection header received
0807 00:34:52.522812 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:52.522815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:52.522829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:52.522901 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:52.523869 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.524808 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.525933 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.526281 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.526370 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.528833 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:52.528835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:52.528836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:52.528845 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:52.530974 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.531398 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.531400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.531400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.531490 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.531747 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.531748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.531748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.531907 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:52.531986 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:52.532258 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 00:34:52.532368 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:34:52.532577 8436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.520647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44829 (local address 127.7.252.1:47401)
0807 00:34:52.520997 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:52.521054 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:52.522708 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:52.522985 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:52.522990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:52.523426 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:52.523738 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:52.523746 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.524932 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.524932 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:52.525835 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:52.525838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.526373 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.526374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:52.526481 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.527128 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:52.527137 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:52.528729 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:52.531062 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:52.531070 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:52.531072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:52.531311 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:52.531573 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:52.531574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:52.531574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:52.531678 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:52.531981 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:52.531985 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:52.532115 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 00:34:52.532203 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 00:34:52.532347 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":241,"threads_started":1}
I20260807 00:34:52.533234 8434 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44829
I20260807 00:34:52.533366 8434 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:34:52.533594 8434 heartbeater.cc:511] Master 127.7.252.62:44829 requested a full tablet report, sending...
I20260807 00:34:52.534194 8229 ts_manager.cc:194] Registered new tserver with Master: e2e8a5e4d26042f494d88ef3554ac9d4 (127.7.252.1:38267)
I20260807 00:34:52.535003 8229 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:47401
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:34:52.559136 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44829
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:52.662796 8439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:52.663122 8439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:52.663175 8439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:52.664513 8439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:52.664593 8439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:52.664650 8439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:34:52.666407 8439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44829
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:52.666733 8439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:52.667026 8439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:52.673480 8444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:52.673524 8439 server_base.cc:1034] running on GCE node
W20260807 00:34:52.673445 8448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:52.673456 8445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:52.673914 8439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:52.674213 8439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:52.675431 8439 hybrid_clock.cc:648] HybridClock initialized: now 1786062892675419 us; error 42 us; skew 500 ppm
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:52.678221 8439 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:34:52.678803 8439 webserver.cc:460] Webserver started at http://127.7.252.2:41979/ using document root <none> and password file <none>
I20260807 00:34:52.679023 8439 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:52.679064 8439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:52.679158 8439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:52.680230 8439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "c1faccab01fb463caf373a91bbbcaa2f"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "102ba5243fb7ad0e09e9553802feff5c"
server_key_iv: "29f8dfad3ad7d220ef6a1b963b53530e"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.680536 8439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "c1faccab01fb463caf373a91bbbcaa2f"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "102ba5243fb7ad0e09e9553802feff5c"
server_key_iv: "29f8dfad3ad7d220ef6a1b963b53530e"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.681936 8439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:34:52.683000 8455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.683293 8439 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:52.683394 8439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "c1faccab01fb463caf373a91bbbcaa2f"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "102ba5243fb7ad0e09e9553802feff5c"
server_key_iv: "29f8dfad3ad7d220ef6a1b963b53530e"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.683455 8439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:52.711288 8439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:52.713908 8439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:52.714039 8439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:52.714250 8439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:34:52.714653 8439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:52.714754 8439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.714798 8439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:52.714824 8439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.721710 8439 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:38437
I20260807 00:34:52.721794 8574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:38437 every 8 connection(s)
I20260807 00:34:52.722162 8439 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:34:52.726492 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8439
I20260807 00:34:52.726599 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:34:52.726864 8176 external_mini_cluster.cc:1428] Setting key 3a018f0e159d872423c37f1228d4d576
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:52.734381 8273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.723107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:55851 (local address 127.7.252.62:44829)
0807 00:34:52.723203 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:52.723206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:52.723465 (+ 259us) server_negotiation.cc:407] Connection header received
0807 00:34:52.723988 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:52.723990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:52.724002 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:52.724074 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:52.725364 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.725985 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.727406 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.727699 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.727783 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.731111 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:52.731113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:52.731113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:52.731120 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:52.732777 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.733244 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.733245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.733246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.733314 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.733614 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.733615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.733615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.733749 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:52.733823 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:52.734167 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 00:34:52.734274 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 00:34:52.734576 8577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.723076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44829 (local address 127.7.252.2:55851)
0807 00:34:52.723277 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:52.723325 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:52.723881 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:52.724272 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:52.724276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:52.724980 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:52.725229 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:52.725235 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.726113 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.726115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:52.727307 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:52.727311 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.727835 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.727837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:52.728026 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.728736 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:52.728748 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:52.730995 (+ 2247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:52.732885 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:52.732895 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:52.732897 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:52.733148 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:52.733414 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:52.733415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:52.733415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:52.733539 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:52.733828 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:52.733835 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:52.734020 (+ 185us) client_negotiation.cc:769] Sending connection context
0807 00:34:52.734135 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 00:34:52.734317 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":123,"threads_started":1}
I20260807 00:34:52.735123 8575 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44829
I20260807 00:34:52.735227 8575 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:52.735455 8575 heartbeater.cc:511] Master 127.7.252.62:44829 requested a full tablet report, sending...
I20260807 00:34:52.735862 8229 ts_manager.cc:194] Registered new tserver with Master: c1faccab01fb463caf373a91bbbcaa2f (127.7.252.2:38437)
I20260807 00:34:52.736265 8229 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:55851
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:34:52.758536 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44829
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:52.847679 8581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:52.847926 8581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:52.847954 8581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:52.849648 8581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:52.849728 8581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:52.849776 8581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:34:52.851598 8581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44829
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:52.851846 8581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:52.852064 8581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:52.858034 8591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:52.858219 8589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:52.858363 8581 server_base.cc:1034] running on GCE node
W20260807 00:34:52.858433 8587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:52.858767 8581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:52.859056 8581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:52.860330 8581 hybrid_clock.cc:648] HybridClock initialized: now 1786062892860347 us; error 68 us; skew 500 ppm
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:52.863385 8581 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:34:52.863992 8581 webserver.cc:460] Webserver started at http://127.7.252.3:43583/ using document root <none> and password file <none>
I20260807 00:34:52.864256 8581 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:52.864334 8581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:52.864507 8581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:52.865705 8581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "74cb95c5bcf64bd3a74530ef128cfe3c"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "30b4439d3d01ba3b0e617719fbf4f5a2"
server_key_iv: "8bebff77bca565f99cf48dd0aa3d48b2"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.866122 8581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "74cb95c5bcf64bd3a74530ef128cfe3c"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "30b4439d3d01ba3b0e617719fbf4f5a2"
server_key_iv: "8bebff77bca565f99cf48dd0aa3d48b2"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.867961 8581 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260807 00:34:52.868923 8599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.869210 8581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:34:52.869313 8581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "74cb95c5bcf64bd3a74530ef128cfe3c"
format_stamp: "Formatted at 2026-08-07 00:34:52 on dist-test-slave-csg5"
server_key: "30b4439d3d01ba3b0e617719fbf4f5a2"
server_key_iv: "8bebff77bca565f99cf48dd0aa3d48b2"
server_key_version: "encryptionkey@0"
I20260807 00:34:52.869423 8581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:52.886389 8581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:52.889308 8581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:52.889519 8581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:52.889845 8581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:34:52.890213 8581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:52.890276 8581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.890321 8581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:52.890372 8581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:52.897783 8581 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40313
I20260807 00:34:52.897838 8714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40313 every 8 connection(s)
I20260807 00:34:52.898238 8581 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:52.905922 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8581
I20260807 00:34:52.906025 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:34:52.906240 8176 external_mini_cluster.cc:1428] Setting key 1a9e69b7172b9011244b5d33d1dedf88
I20260807 00:34:52.909683 8273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.899200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:60935 (local address 127.7.252.62:44829)
0807 00:34:52.899382 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:52.899385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:52.899510 (+ 125us) server_negotiation.cc:407] Connection header received
0807 00:34:52.900025 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:52.900026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:52.900036 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:52.900103 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:52.901597 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.902117 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.903369 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.903577 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.903639 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.906175 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:52.906176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:52.906177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:52.906186 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:52.907931 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.908485 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.908486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.908487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.908555 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.908909 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.908910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.908910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.909054 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:52.909128 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:52.909519 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 00:34:52.909598 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260807 00:34:52.909795 8717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.899175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44829 (local address 127.7.252.3:60935)
0807 00:34:52.899351 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:52.899398 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:52.899933 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:52.900171 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:52.900174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:52.901233 (+ 1059us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:52.901468 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:52.901474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.902313 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.902314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:52.903274 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:52.903277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.903704 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.903705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:52.903834 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.904426 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:52.904436 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:52.906056 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:52.908041 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:52.908048 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:52.908050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:52.908377 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:52.908672 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:52.908673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:52.908673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:52.908809 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:52.909140 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:52.909146 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:52.909361 (+ 215us) client_negotiation.cc:769] Sending connection context
0807 00:34:52.909460 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 00:34:52.909611 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260807 00:34:52.910450 8715 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44829
I20260807 00:34:52.910558 8715 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:52.910835 8715 heartbeater.cc:511] Master 127.7.252.62:44829 requested a full tablet report, sending...
I20260807 00:34:52.911334 8229 ts_manager.cc:194] Registered new tserver with Master: 74cb95c5bcf64bd3a74530ef128cfe3c (127.7.252.3:40313)
I20260807 00:34:52.911689 8229 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:60935
I20260807 00:34:52.919203 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:34:52.946897 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.936955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50074 (local address 127.7.252.1:38267)
0807 00:34:52.937175 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:52.937179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:52.937191 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:34:52.937220 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:52.937221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:52.937236 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:52.937340 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:52.938107 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.939051 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.939917 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.940286 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.940375 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.943411 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:52.943422 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:52.943423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:52.943430 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:52.945227 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.945723 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.945727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.945727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.945798 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.946042 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.946044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.946044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.946257 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:52.946390 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:52.946621 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 00:34:52.946801 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":98,"threads_started":1}
W20260807 00:34:52.947388 8326 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50074
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 00:34:52 dist-test-slave-csg5 krb5kdc[8183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:34:52.974865 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:52.965495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.7.252.1:38267)
0807 00:34:52.965596 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:52.965598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:52.965608 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:52.965635 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:52.965636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:52.965649 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:52.965705 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:52.966426 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.967049 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.968102 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:52.968311 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:52.968478 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:52.971390 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:52.971391 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:52.971391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:52.971400 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:52.973271 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.973752 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.973753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.973754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.973819 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:52.974104 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:52.974105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:52.974105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:52.974249 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:52.974368 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:52.974603 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 00:34:52.974789 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 00:34:52.975929 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8296
I20260807 00:34:52.982865 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8439
I20260807 00:34:52.989972 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8581
I20260807 00:34:52.995103 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8196
2026-08-07T00:34:52Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2937 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:34:53 dist-test-slave-csg5 krb5kdc[8730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:34:53 dist-test-slave-csg5 krb5kdc[8730](info): set up 2 sockets
Aug 07 00:34:53 dist-test-slave-csg5 krb5kdc[8730](info): commencing operation
krb5kdc: starting...
W20260807 00:34:54.132464 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:34:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:34:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:34:54.274719 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:46231
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:54.363345 8743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:54.363615 8743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:54.363670 8743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:54.364977 8743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:34:54.365051 8743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:54.365077 8743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:54.365103 8743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:34:54.365135 8743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:34:54.367569 8743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:46231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:46231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:54.367923 8743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:54.368181 8743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:54.373729 8749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.373757 8752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.373771 8750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:54.374312 8743 server_base.cc:1034] running on GCE node
I20260807 00:34:54.374593 8743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:54.374943 8743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:54.376135 8743 hybrid_clock.cc:648] HybridClock initialized: now 1786062894376121 us; error 46 us; skew 500 ppm
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:54.379037 8743 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:34:54.379568 8743 webserver.cc:460] Webserver started at http://127.7.252.62:39173/ using document root <none> and password file <none>
I20260807 00:34:54.379774 8743 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:54.379818 8743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:54.379917 8743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:54.380990 8743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "73297821a4bf48538a0b5a739a55cf53"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "baeed96ab2a5a82f0ccdc39b12edbbbc"
server_key_iv: "424480d904cf4cf0bc6615712687c1de"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.381309 8743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "73297821a4bf48538a0b5a739a55cf53"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "baeed96ab2a5a82f0ccdc39b12edbbbc"
server_key_iv: "424480d904cf4cf0bc6615712687c1de"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.382738 8743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:34:54.383646 8759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.383881 8743 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:54.383989 8743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "73297821a4bf48538a0b5a739a55cf53"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "baeed96ab2a5a82f0ccdc39b12edbbbc"
server_key_iv: "424480d904cf4cf0bc6615712687c1de"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.384057 8743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:54.396183 8743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:54.398586 8743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:54.398798 8743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:54.403229 8743 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:46231
I20260807 00:34:54.403263 8813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:46231 every 8 connection(s)
I20260807 00:34:54.403643 8743 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:34:54.404726 8814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:54.407348 8814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53: Bootstrap starting.
I20260807 00:34:54.407997 8814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:54.408325 8814 log.cc:824] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:54.409154 8814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53: No bootstrap required, opened a new log
I20260807 00:34:54.411093 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8743
I20260807 00:34:54.411186 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:34:54.411094 8814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73297821a4bf48538a0b5a739a55cf53" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46231 } }
I20260807 00:34:54.411321 8814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:54.411374 8176 external_mini_cluster.cc:1428] Setting key 90c4f340988f820526e7e9b138c79196
I20260807 00:34:54.411399 8814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73297821a4bf48538a0b5a739a55cf53, State: Initialized, Role: FOLLOWER
I20260807 00:34:54.411559 8814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73297821a4bf48538a0b5a739a55cf53" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46231 } }
I20260807 00:34:54.411656 8814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:34:54.411693 8814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:34:54.411742 8814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:54.412987 8814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73297821a4bf48538a0b5a739a55cf53" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46231 } }
I20260807 00:34:54.413125 8814 leader_election.cc:302] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73297821a4bf48538a0b5a739a55cf53; no voters:
I20260807 00:34:54.413331 8814 leader_election.cc:288] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:34:54.413389 8819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:54.413595 8819 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [term 1 LEADER]: Becoming Leader. State: Replica: 73297821a4bf48538a0b5a739a55cf53, State: Running, Role: LEADER
I20260807 00:34:54.413617 8814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:34:54.413710 8819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73297821a4bf48538a0b5a739a55cf53" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46231 } }
I20260807 00:34:54.414177 8819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73297821a4bf48538a0b5a739a55cf53. Latest consensus state: current_term: 1 leader_uuid: "73297821a4bf48538a0b5a739a55cf53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73297821a4bf48538a0b5a739a55cf53" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46231 } } }
I20260807 00:34:54.414304 8819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:54.414196 8820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73297821a4bf48538a0b5a739a55cf53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73297821a4bf48538a0b5a739a55cf53" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46231 } } }
I20260807 00:34:54.414479 8820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53 [sys.catalog]: This master's current role is: LEADER
W20260807 00:34:54.415858 8837 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:34:54.415925 8837 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:34:54.416005 8838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:34:54.416208 8838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:34:54.417817 8838 catalog_manager.cc:1347] Generated new cluster ID: b26cc83942214734ab0f5ff62678f6e1
I20260807 00:34:54.417876 8838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:54.424404 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.412007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34740 (local address 127.7.252.62:46231)
0807 00:34:54.412266 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:54.412277 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:54.412323 (+ 46us) server_negotiation.cc:407] Connection header received
0807 00:34:54.412476 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:54.412484 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:54.412558 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:54.412744 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:54.413528 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.415232 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.416355 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.416978 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.417060 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:54.420292 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:54.420296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:54.420296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:54.420311 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:54.422451 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:54.423017 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:54.423021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:54.423021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:54.423153 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:54.423396 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:54.423396 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:54.423397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:54.423727 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:54.423890 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:54.424020 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 00:34:54.424167 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":136,"threads_started":1}
I20260807 00:34:54.445544 8838 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:34:54.446141 8838 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:34:54.453019 8838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73297821a4bf48538a0b5a739a55cf53: Generated new TSK 0
I20260807 00:34:54.453256 8838 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:34:54.490998 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46231
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:54.578282 8843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:54.578516 8843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:54.578543 8843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:54.579933 8843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:54.579991 8843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:54.580024 8843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:34:54.581686 8843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46231
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:54.581972 8843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:54.582258 8843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:34:54.587950 8843 server_base.cc:1034] running on GCE node
W20260807 00:34:54.587905 8848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.587875 8849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.587956 8851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:54.588546 8843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:54.588836 8843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:54.590021 8843 hybrid_clock.cc:648] HybridClock initialized: now 1786062894589997 us; error 32 us; skew 500 ppm
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:54.593122 8843 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:34:54.593807 8843 webserver.cc:460] Webserver started at http://127.7.252.1:42159/ using document root <none> and password file <none>
I20260807 00:34:54.594113 8843 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:54.594213 8843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:54.594393 8843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:54.595741 8843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "bae3d6915bf3499f97363db907b99edb"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "cde55a44eb2781f4650034cb68a9541d"
server_key_iv: "94c21b9ed92c7e7de94b00a452df5b83"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.596164 8843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "bae3d6915bf3499f97363db907b99edb"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "cde55a44eb2781f4650034cb68a9541d"
server_key_iv: "94c21b9ed92c7e7de94b00a452df5b83"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.597930 8843 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 00:34:54.599112 8860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.599380 8843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:54.599509 8843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "bae3d6915bf3499f97363db907b99edb"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "cde55a44eb2781f4650034cb68a9541d"
server_key_iv: "94c21b9ed92c7e7de94b00a452df5b83"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.599598 8843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:54.618083 8843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:54.620618 8843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:54.620823 8843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:54.621096 8843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:34:54.621438 8843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:54.621493 8843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.621538 8843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:54.621569 8843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.628551 8843 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:39853
I20260807 00:34:54.628602 8982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:39853 every 8 connection(s)
I20260807 00:34:54.628974 8843 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:54.638113 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8843
I20260807 00:34:54.638214 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:34:54.638525 8176 external_mini_cluster.cc:1428] Setting key e7cf706ec10dabde4f2a1ee142837e37
I20260807 00:34:54.641280 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.629861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:36437 (local address 127.7.252.62:46231)
0807 00:34:54.630011 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:54.630014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:54.630424 (+ 410us) server_negotiation.cc:407] Connection header received
0807 00:34:54.631612 (+ 1188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:54.631614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:54.631641 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:54.631714 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:54.632514 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.633148 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.634342 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.634586 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.634702 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:54.637337 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:54.637339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:54.637339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:54.637349 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:54.639663 (+ 2314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:54.640177 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:54.640179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:54.640179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:54.640247 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:54.640533 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:54.640534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:54.640535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:54.640667 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:54.640743 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:54.641054 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 00:34:54.641186 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260807 00:34:54.641484 8985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.629766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:46231 (local address 127.7.252.1:36437)
0807 00:34:54.630048 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:54.630167 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:54.631452 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:54.631812 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:54.631817 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:54.632149 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:54.632385 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:54.632390 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.633277 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.633278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:54.634224 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:54.634226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.634729 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.634731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:54.634891 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:54.635562 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:54.635572 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:54.637205 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:54.639783 (+ 2578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:54.639795 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:54.639798 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:54.640067 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:54.640326 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:54.640327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:54.640327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:54.640454 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:54.640743 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:54.640752 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:54.640907 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 00:34:54.641018 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 00:34:54.641220 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":122,"threads_started":1}
I20260807 00:34:54.642114 8983 heartbeater.cc:347] Connected to a master server at 127.7.252.62:46231
I20260807 00:34:54.642225 8983 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:54.642428 8983 heartbeater.cc:511] Master 127.7.252.62:46231 requested a full tablet report, sending...
I20260807 00:34:54.643162 8776 ts_manager.cc:194] Registered new tserver with Master: bae3d6915bf3499f97363db907b99edb (127.7.252.1:39853)
I20260807 00:34:54.644284 8776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:36437
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:34:54.674947 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46231
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:54.763782 8989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:54.764001 8989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:54.764026 8989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:54.765223 8989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:54.765271 8989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:54.765305 8989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:34:54.767571 8989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46231
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:54.767903 8989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:54.768213 8989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:34:54.774300 8989 server_base.cc:1034] running on GCE node
W20260807 00:34:54.774333 8995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.774468 8996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.774488 8998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:54.774775 8989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:54.775133 8989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:54.776383 8989 hybrid_clock.cc:648] HybridClock initialized: now 1786062894776365 us; error 35 us; skew 500 ppm
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:54.779521 8989 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:34:54.780090 8989 webserver.cc:460] Webserver started at http://127.7.252.2:40311/ using document root <none> and password file <none>
I20260807 00:34:54.780376 8989 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:54.780457 8989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:54.780615 8989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:54.781790 8989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "f608103e15dc492a97e3525a0a11790a"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "40012173d50ea0ac4006613728b1cf0e"
server_key_iv: "05c4472d2c322279690a79df7f269bc5"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.782192 8989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "f608103e15dc492a97e3525a0a11790a"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "40012173d50ea0ac4006613728b1cf0e"
server_key_iv: "05c4472d2c322279690a79df7f269bc5"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.783938 8989 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 00:34:54.785085 9005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.785409 8989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 00:34:54.785534 8989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "f608103e15dc492a97e3525a0a11790a"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "40012173d50ea0ac4006613728b1cf0e"
server_key_iv: "05c4472d2c322279690a79df7f269bc5"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.785621 8989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:54.817278 8989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:54.819872 8989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:54.820065 8989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:54.820361 8989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:34:54.820696 8989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:54.820752 8989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.820796 8989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:54.820824 8989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.827179 8989 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:36367
I20260807 00:34:54.827219 9123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:36367 every 8 connection(s)
I20260807 00:34:54.827562 8989 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:34:54.831905 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 8989
I20260807 00:34:54.831997 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:34:54.832180 8176 external_mini_cluster.cc:1428] Setting key 6a2b0b59ff248a866a2c4b1d029be524
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:54.839053 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.828443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:49043 (local address 127.7.252.62:46231)
0807 00:34:54.828531 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:54.828533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:54.828720 (+ 187us) server_negotiation.cc:407] Connection header received
0807 00:34:54.829801 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:54.829803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:54.829815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:54.829886 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:54.830645 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.831336 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.832617 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.832982 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.833037 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:54.835914 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:54.835920 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:54.835920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:54.835927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:54.837433 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:54.837944 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:54.837946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:54.837946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:54.838012 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:54.838284 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:54.838285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:54.838285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:54.838424 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:54.838503 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:54.838859 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 00:34:54.838954 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 00:34:54.839278 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.828354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:46231 (local address 127.7.252.2:49043)
0807 00:34:54.828563 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:54.828612 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:54.829663 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:54.829998 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:54.830002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:54.830320 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:54.830536 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:54.830542 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.831443 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.831445 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:54.832500 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:54.832504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.833072 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.833074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:54.833208 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:54.833895 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:54.833904 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:54.835719 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:54.837562 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:54.837571 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:54.837573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:54.837857 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:54.838081 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:54.838082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:54.838083 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:54.838211 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:54.838493 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:54.838499 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:54.838700 (+ 201us) client_negotiation.cc:769] Sending connection context
0807 00:34:54.838838 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 00:34:54.839013 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260807 00:34:54.839990 9124 heartbeater.cc:347] Connected to a master server at 127.7.252.62:46231
I20260807 00:34:54.840111 9124 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:54.840317 9124 heartbeater.cc:511] Master 127.7.252.62:46231 requested a full tablet report, sending...
I20260807 00:34:54.840827 8776 ts_manager.cc:194] Registered new tserver with Master: f608103e15dc492a97e3525a0a11790a (127.7.252.2:36367)
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:34:54.841392 8776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:49043
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:34:54.863081 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46231
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:54.948920 9130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:54.949160 9130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:54.949188 9130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:54.950481 9130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:54.950531 9130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:54.950560 9130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:34:54.952236 9130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46231
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:54.952508 9130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:54.952818 9130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:54.958258 9135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:54.958444 9130 server_base.cc:1034] running on GCE node
W20260807 00:34:54.958256 9138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:54.958256 9136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:54.958823 9130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:54.959137 9130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:54.960379 9130 hybrid_clock.cc:648] HybridClock initialized: now 1786062894960342 us; error 48 us; skew 500 ppm
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:54.963343 9130 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:34:54.963848 9130 webserver.cc:460] Webserver started at http://127.7.252.3:39875/ using document root <none> and password file <none>
I20260807 00:34:54.964138 9130 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:54.964304 9130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:54.964465 9130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:54.965638 9130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "5bb4997cb819455eb6ea43ff8b7ea463"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "246c4c029a0b5bbf8b5a0c2221a02e68"
server_key_iv: "5b5d9d069d0b2b8ed026d64211a5b1cd"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.966250 9130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "5bb4997cb819455eb6ea43ff8b7ea463"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "246c4c029a0b5bbf8b5a0c2221a02e68"
server_key_iv: "5b5d9d069d0b2b8ed026d64211a5b1cd"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.967880 9130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260807 00:34:54.968786 9145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.969034 9130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:54.969158 9130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "5bb4997cb819455eb6ea43ff8b7ea463"
format_stamp: "Formatted at 2026-08-07 00:34:54 on dist-test-slave-csg5"
server_key: "246c4c029a0b5bbf8b5a0c2221a02e68"
server_key_iv: "5b5d9d069d0b2b8ed026d64211a5b1cd"
server_key_version: "encryptionkey@0"
I20260807 00:34:54.969228 9130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:54.981832 9130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:54.984479 9130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:54.984668 9130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:54.984943 9130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:34:54.985291 9130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:54.985350 9130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.985394 9130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:54.985450 9130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:54.992174 9130 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:39475
I20260807 00:34:54.992216 9266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:39475 every 8 connection(s)
I20260807 00:34:54.992616 9130 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:34:54.999089 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 9130
I20260807 00:34:54.999184 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:34:54.999462 8176 external_mini_cluster.cc:1428] Setting key 0e466628b0217195a17026080b8a0442
Aug 07 00:34:54 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:55.003860 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.993409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:34035 (local address 127.7.252.62:46231)
0807 00:34:54.993485 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:54.993487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:54.993819 (+ 332us) server_negotiation.cc:407] Connection header received
0807 00:34:54.995042 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:54.995043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:54.995055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:54.995116 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:54.995929 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.996424 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.997540 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.997729 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.997804 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.000427 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:55.000428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:55.000429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:55.000437 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:55.002051 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.002629 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.002631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.002632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.002792 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.003068 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.003070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.003070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.003199 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:55.003356 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.003656 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.003754 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 00:34:55.004069 9270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:54.993394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:46231 (local address 127.7.252.3:34035)
0807 00:34:54.993633 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:54.993676 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:54.994929 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:54.995194 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:54.995198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:54.995568 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:54.995819 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:54.995824 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.996520 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.996521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:54.997436 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:54.997438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:54.997824 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:54.997825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:54.997931 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:54.998568 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:54.998577 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:55.000316 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:55.002145 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:55.002175 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:55.002178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:55.002524 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:55.002879 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:55.002880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:55.002880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:55.002994 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:55.003331 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:55.003338 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:55.003498 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 00:34:55.003614 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 00:34:55.003814 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":93,"threads_started":1}
I20260807 00:34:55.004757 9268 heartbeater.cc:347] Connected to a master server at 127.7.252.62:46231
I20260807 00:34:55.004887 9268 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:55.005117 9268 heartbeater.cc:511] Master 127.7.252.62:46231 requested a full tablet report, sending...
I20260807 00:34:55.005661 8776 ts_manager.cc:194] Registered new tserver with Master: 5bb4997cb819455eb6ea43ff8b7ea463 (127.7.252.3:39475)
I20260807 00:34:55.006075 8776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:34035
I20260807 00:34:55.011740 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:34:55.021287 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.013758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34742 (local address 127.7.252.62:46231)
0807 00:34:55.013858 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.013861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.013968 (+ 107us) server_negotiation.cc:407] Connection header received
0807 00:34:55.014096 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.014096 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.014109 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.014193 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:55.015097 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.015714 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.016605 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.016844 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.016929 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.018402 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:55.018404 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:55.018404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:55.018412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:55.019992 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.020402 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.020403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.020404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.020467 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.020677 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.020678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.020679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.020856 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:55.020968 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.021086 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.021174 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 00:34:55.024122 8776 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:34:55.025929 8776 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:34:55.034065 9281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.029121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:39853 (local address 127.0.0.1:36098)
0807 00:34:55.029425 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:55.029438 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:55.029500 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:55.029992 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:55.029997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:55.030000 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:55.030087 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.030089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.031281 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.031282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.032743 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.032746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.033733 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.033734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.033816 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.033819 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:34:55.033856 (+ 37us) client_negotiation.cc:240] Negotiation successful
0807 00:34:55.033954 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":66,"spinlock_wait_cycles":768,"thread_start_us":123,"threads_started":1}
I20260807 00:34:55.034070 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.029733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52584 (local address 127.7.252.2:36367)
0807 00:34:55.029966 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.029971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.029981 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:55.030029 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.030031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.030047 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.030133 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:55.030402 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.031567 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.032991 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.033562 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.033665 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.033738 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.033923 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.033968 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":90,"threads_started":1}
I20260807 00:34:55.034246 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.029120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:39475 (local address 127.0.0.1:59262)
0807 00:34:55.029245 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:55.029287 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:55.029381 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:55.030217 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:55.030218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:55.030221 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:55.030272 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.030273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.031837 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.031838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.032764 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.032767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.033737 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.033737 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.033811 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.033816 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:34:55.033857 (+ 41us) client_negotiation.cc:240] Negotiation successful
0807 00:34:55.033954 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":61,"thread_start_us":79,"threads_started":1}
I20260807 00:34:55.034255 9284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.029432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59262 (local address 127.7.252.3:39475)
0807 00:34:55.029646 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.029652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.030041 (+ 389us) server_negotiation.cc:407] Connection header received
0807 00:34:55.030085 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.030087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.030104 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.030339 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:55.030442 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.031580 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.032889 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.033626 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.034029 (+ 403us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.034100 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.034127 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.034177 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":104,"threads_started":1}
I20260807 00:34:55.034729 9285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.029455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36098 (local address 127.7.252.1:39853)
0807 00:34:55.029693 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.029698 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.029712 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:34:55.029793 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.029795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.029814 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.029967 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:55.030181 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.031139 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.032836 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.033610 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.034430 (+ 820us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.034508 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.034536 (+ 28us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.034587 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":128,"threads_started":1}
I20260807 00:34:55.034873 9282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.029121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:36367 (local address 127.0.0.1:52584)
0807 00:34:55.029679 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:55.029691 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:55.029800 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:55.030132 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:55.030133 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:55.030135 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:55.030180 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.030181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.031700 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.031701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.032898 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.032900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.033668 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.033670 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.033778 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.033799 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 00:34:55.033901 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 00:34:55.033962 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":7,"thread_start_us":116,"threads_started":1}
I20260807 00:34:55.035218 9197 tablet_service.cc:1467] Processing CreateTablet for tablet e29cd20ff03f49bc945d3daf3b539f65 (DEFAULT_TABLE table=test-table [id=a450579611af475dac97daa97f3d4d83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:55.035629 9197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29cd20ff03f49bc945d3daf3b539f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:55.035800 9056 tablet_service.cc:1467] Processing CreateTablet for tablet e29cd20ff03f49bc945d3daf3b539f65 (DEFAULT_TABLE table=test-table [id=a450579611af475dac97daa97f3d4d83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:55.036167 9056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29cd20ff03f49bc945d3daf3b539f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:55.038738 9287 tablet_bootstrap.cc:492] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: Bootstrap starting.
I20260807 00:34:55.039170 9288 tablet_bootstrap.cc:492] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: Bootstrap starting.
I20260807 00:34:55.039354 8914 tablet_service.cc:1467] Processing CreateTablet for tablet e29cd20ff03f49bc945d3daf3b539f65 (DEFAULT_TABLE table=test-table [id=a450579611af475dac97daa97f3d4d83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:55.039736 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29cd20ff03f49bc945d3daf3b539f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:55.039857 9288 tablet_bootstrap.cc:654] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:55.039891 9287 tablet_bootstrap.cc:654] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:55.040419 9287 log.cc:824] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:55.040472 9288 log.cc:824] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:55.041256 9287 tablet_bootstrap.cc:492] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: No bootstrap required, opened a new log
I20260807 00:34:55.041354 9287 ts_tablet_manager.cc:1397] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:34:55.042887 9291 tablet_bootstrap.cc:492] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: Bootstrap starting.
I20260807 00:34:55.042855 9287 raft_consensus.cc:348] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.043047 9287 raft_consensus.cc:374] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:55.043097 9287 raft_consensus.cc:729] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb4997cb819455eb6ea43ff8b7ea463, State: Initialized, Role: FOLLOWER
I20260807 00:34:55.043236 9288 tablet_bootstrap.cc:492] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: No bootstrap required, opened a new log
I20260807 00:34:55.043215 9287 consensus_queue.cc:260] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.043310 9288 ts_tablet_manager.cc:1397] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 00:34:55.043540 9287 ts_tablet_manager.cc:1428] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:34:55.043722 9268 heartbeater.cc:503] Master 127.7.252.62:46231 was elected leader, sending a full tablet report...
I20260807 00:34:55.043834 9291 tablet_bootstrap.cc:654] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:55.044469 9291 log.cc:824] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:55.045401 9291 tablet_bootstrap.cc:492] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: No bootstrap required, opened a new log
I20260807 00:34:55.045472 9291 ts_tablet_manager.cc:1397] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:34:55.045416 9288 raft_consensus.cc:348] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.045594 9288 raft_consensus.cc:374] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:55.045636 9288 raft_consensus.cc:729] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f608103e15dc492a97e3525a0a11790a, State: Initialized, Role: FOLLOWER
I20260807 00:34:55.045758 9288 consensus_queue.cc:260] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.046062 9288 ts_tablet_manager.cc:1428] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:34:55.046082 9124 heartbeater.cc:503] Master 127.7.252.62:46231 was elected leader, sending a full tablet report...
I20260807 00:34:55.047508 9291 raft_consensus.cc:348] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.047667 9291 raft_consensus.cc:374] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:55.047693 9291 raft_consensus.cc:729] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae3d6915bf3499f97363db907b99edb, State: Initialized, Role: FOLLOWER
I20260807 00:34:55.047823 9291 consensus_queue.cc:260] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.048117 9291 ts_tablet_manager.cc:1428] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:34:55.048142 8983 heartbeater.cc:503] Master 127.7.252.62:46231 was elected leader, sending a full tablet report...
W20260807 00:34:55.078142 9125 tablet.cc:2369] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:34:55.129921 8984 tablet.cc:2369] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:34:55.155375 9292 raft_consensus.cc:482] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:34:55.155503 9292 raft_consensus.cc:504] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.155875 9292 leader_election.cc:288] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae3d6915bf3499f97363db907b99edb (127.7.252.1:39853), f608103e15dc492a97e3525a0a11790a (127.7.252.2:36367)
I20260807 00:34:55.159205 9285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.156187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:42939 (local address 127.7.252.1:39853)
0807 00:34:55.156250 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.156252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.156262 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:55.156382 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.156383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.156399 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.156502 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:55.156690 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.157222 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.158291 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.158788 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.158878 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.158889 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.159073 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.159113 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 00:34:55.159229 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.156256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:44403 (local address 127.7.252.2:36367)
0807 00:34:55.156326 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.156328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.156589 (+ 261us) server_negotiation.cc:407] Connection header received
0807 00:34:55.156661 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.156662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.156675 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.156727 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:55.156882 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.157350 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.158367 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.158834 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.158936 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.158947 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.159115 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.159154 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:34:55.159250 9270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.156093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:39853 (local address 127.7.252.3:42939)
0807 00:34:55.156174 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:55.156185 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:55.156237 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:55.156507 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:55.156509 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:55.156511 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:55.156596 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.156598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.157315 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.157317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.158175 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.158178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.158876 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.158877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.158976 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.158980 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:34:55.159064 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 00:34:55.159113 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 00:34:55.159261 9296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.156093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:36367 (local address 127.7.252.3:44403)
0807 00:34:55.156509 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:55.156525 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:55.156598 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:55.156734 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:55.156735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:55.156737 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:55.156813 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.156815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.157436 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.157437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.158258 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:55.158261 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.158939 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.158940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:55.159028 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.159031 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:34:55.159107 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 00:34:55.159148 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":192,"thread_start_us":107,"threads_started":1}
I20260807 00:34:55.159710 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29cd20ff03f49bc945d3daf3b539f65" candidate_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae3d6915bf3499f97363db907b99edb" is_pre_election: true
I20260807 00:34:55.159898 8934 raft_consensus.cc:2454] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb4997cb819455eb6ea43ff8b7ea463 in term 0.
I20260807 00:34:55.160146 9076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29cd20ff03f49bc945d3daf3b539f65" candidate_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f608103e15dc492a97e3525a0a11790a" is_pre_election: true
I20260807 00:34:55.160212 9149 leader_election.cc:302] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb4997cb819455eb6ea43ff8b7ea463, bae3d6915bf3499f97363db907b99edb; no voters:
I20260807 00:34:55.160322 9076 raft_consensus.cc:2454] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb4997cb819455eb6ea43ff8b7ea463 in term 0.
I20260807 00:34:55.160355 9292 raft_consensus.cc:2781] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:34:55.160460 9292 raft_consensus.cc:482] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:34:55.160501 9292 raft_consensus.cc:3037] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:55.161274 9292 raft_consensus.cc:504] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.161453 9292 leader_election.cc:288] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [CANDIDATE]: Term 1 election: Requested vote from peers bae3d6915bf3499f97363db907b99edb (127.7.252.1:39853), f608103e15dc492a97e3525a0a11790a (127.7.252.2:36367)
I20260807 00:34:55.161684 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29cd20ff03f49bc945d3daf3b539f65" candidate_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae3d6915bf3499f97363db907b99edb"
I20260807 00:34:55.161671 9076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29cd20ff03f49bc945d3daf3b539f65" candidate_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f608103e15dc492a97e3525a0a11790a"
I20260807 00:34:55.161759 9076 raft_consensus.cc:3037] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:55.161787 8934 raft_consensus.cc:3037] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:55.162544 8934 raft_consensus.cc:2454] T e29cd20ff03f49bc945d3daf3b539f65 P bae3d6915bf3499f97363db907b99edb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb4997cb819455eb6ea43ff8b7ea463 in term 1.
I20260807 00:34:55.162606 9076 raft_consensus.cc:2454] T e29cd20ff03f49bc945d3daf3b539f65 P f608103e15dc492a97e3525a0a11790a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb4997cb819455eb6ea43ff8b7ea463 in term 1.
I20260807 00:34:55.162786 9149 leader_election.cc:302] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb4997cb819455eb6ea43ff8b7ea463, bae3d6915bf3499f97363db907b99edb; no voters:
I20260807 00:34:55.162883 9292 raft_consensus.cc:2781] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:55.163048 9292 raft_consensus.cc:686] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [term 1 LEADER]: Becoming Leader. State: Replica: 5bb4997cb819455eb6ea43ff8b7ea463, State: Running, Role: LEADER
I20260807 00:34:55.163129 9292 consensus_queue.cc:237] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } }
I20260807 00:34:55.164242 8776 catalog_manager.cc:5495] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb4997cb819455eb6ea43ff8b7ea463 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae3d6915bf3499f97363db907b99edb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 39853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f608103e15dc492a97e3525a0a11790a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb4997cb819455eb6ea43ff8b7ea463" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39475 } health_report { overall_health: HEALTHY } } }
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:34:55.184692 9285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.176246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36110 (local address 127.7.252.1:39853)
0807 00:34:55.176332 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.176334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.176494 (+ 160us) server_negotiation.cc:407] Connection header received
0807 00:34:55.176523 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.176525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.176536 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.176583 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:55.177197 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.177682 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.178519 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.178823 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.178893 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.181541 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:55.181555 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:55.181556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:55.181564 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:55.183405 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.183786 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.183790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.183790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.183861 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.184065 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.184066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.184066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.184300 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:55.184416 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.184486 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.184563 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062895, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062895, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:34:55.214416 9285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.204888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36112 (local address 127.7.252.1:39853)
0807 00:34:55.205057 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.205061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.205138 (+ 77us) server_negotiation.cc:407] Connection header received
0807 00:34:55.205345 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.205346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.205358 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.205436 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:55.206050 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.206561 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.207634 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.207877 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.207965 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.210728 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:55.210730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:55.210735 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:55.210745 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:55.212649 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.213319 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.213320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.213321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.213405 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.213711 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.213712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.213712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.213840 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:55.213981 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.214194 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.214300 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[8730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:34:55.241570 9285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:55.233574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36124 (local address 127.7.252.1:39853)
0807 00:34:55.233675 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:55.233677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:55.233772 (+ 95us) server_negotiation.cc:407] Connection header received
0807 00:34:55.233824 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:55.233825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:55.233835 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:55.233897 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:55.234535 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.235115 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.235934 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:55.236133 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:55.236196 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:55.238807 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:55.238808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:55.238809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:55.238817 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:55.240377 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.240773 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.240774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.240774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.240856 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:55.241063 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:55.241064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:55.241064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:55.241188 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:55.241279 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:55.241421 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 00:34:55.241494 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 00:34:55.242172 8891 tablet_service.cc:2908] Rejecting scan request for tablet e29cd20ff03f49bc945d3daf3b539f65: Uninitialized: clean time has not yet been initialized
W20260807 00:34:55.243186 9269 tablet.cc:2369] T e29cd20ff03f49bc945d3daf3b539f65 P 5bb4997cb819455eb6ea43ff8b7ea463: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:34:55.243350 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8843
I20260807 00:34:55.250782 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8989
I20260807 00:34:55.258188 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 9130
I20260807 00:34:55.263780 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 8743
2026-08-07T00:34:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2268 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[9311](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[9311](info): set up 2 sockets
Aug 07 00:34:55 dist-test-slave-csg5 krb5kdc[9311](info): commencing operation
krb5kdc: starting...
W20260807 00:34:56.400561 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:34:56 dist-test-slave-csg5 krb5kdc[9311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:34:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:34:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:34:56.543431 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:42659
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:42659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:56.626969 9324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:56.627240 9324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:56.627282 9324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:56.628475 9324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:34:56.628553 9324 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 00:34:56.628578 9324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:56.628599 9324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:56.628630 9324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:34:56.628654 9324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:34:56.630211 9324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:42659
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:42659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:56.630534 9324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:56.630833 9324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:56.636338 9330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:56.636354 9329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:56.636425 9324 server_base.cc:1034] running on GCE node
W20260807 00:34:56.636381 9332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:56.636972 9324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:56.637360 9324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:56.638537 9324 hybrid_clock.cc:648] HybridClock initialized: now 1786062896638514 us; error 43 us; skew 500 ppm
Aug 07 00:34:56 dist-test-slave-csg5 krb5kdc[9311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062896, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:56.645597 9324 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:34:56.646097 9324 webserver.cc:460] Webserver started at http://127.7.252.62:37079/ using document root <none> and password file <none>
I20260807 00:34:56.646335 9324 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:56.646385 9324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:56.646500 9324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:56.647796 9324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "a75870fb30a44e059dca36419d8f36b4"
format_stamp: "Formatted at 2026-08-07 00:34:56 on dist-test-slave-csg5"
server_key: "7ee5e004048237e4481e80a7a2b629c7"
server_key_iv: "762cfa384ce5f8a6afc55156890f42ea"
server_key_version: "encryptionkey@0"
I20260807 00:34:56.648170 9324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "a75870fb30a44e059dca36419d8f36b4"
format_stamp: "Formatted at 2026-08-07 00:34:56 on dist-test-slave-csg5"
server_key: "7ee5e004048237e4481e80a7a2b629c7"
server_key_iv: "762cfa384ce5f8a6afc55156890f42ea"
server_key_version: "encryptionkey@0"
I20260807 00:34:56.649755 9324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:34:56.650707 9339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:56.650921 9324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:56.651041 9324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "a75870fb30a44e059dca36419d8f36b4"
format_stamp: "Formatted at 2026-08-07 00:34:56 on dist-test-slave-csg5"
server_key: "7ee5e004048237e4481e80a7a2b629c7"
server_key_iv: "762cfa384ce5f8a6afc55156890f42ea"
server_key_version: "encryptionkey@0"
I20260807 00:34:56.651136 9324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:56.695430 9324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:56.698118 9324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:56.698400 9324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:56.704200 9324 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:42659
I20260807 00:34:56.704245 9403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:42659 every 8 connection(s)
I20260807 00:34:56.704639 9324 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:34:56.705327 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:56.707931 9404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: Bootstrap starting.
I20260807 00:34:56.708635 9404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:56.708897 9404 log.cc:824] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:56.709613 9404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: No bootstrap required, opened a new log
I20260807 00:34:56.710090 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 9324
I20260807 00:34:56.710193 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:34:56.710362 8176 external_mini_cluster.cc:1428] Setting key 54cfca2e2ea81dce6234aa8d889c03ed
I20260807 00:34:56.712632 9404 raft_consensus.cc:348] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75870fb30a44e059dca36419d8f36b4" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42659 } }
I20260807 00:34:56.712826 9404 raft_consensus.cc:374] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:56.712893 9404 raft_consensus.cc:729] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a75870fb30a44e059dca36419d8f36b4, State: Initialized, Role: FOLLOWER
I20260807 00:34:56.713088 9404 consensus_queue.cc:260] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75870fb30a44e059dca36419d8f36b4" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42659 } }
I20260807 00:34:56.713178 9404 raft_consensus.cc:388] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:34:56.713201 9404 raft_consensus.cc:482] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:34:56.713249 9404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:56.713888 9404 raft_consensus.cc:504] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75870fb30a44e059dca36419d8f36b4" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42659 } }
I20260807 00:34:56.714016 9404 leader_election.cc:302] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a75870fb30a44e059dca36419d8f36b4; no voters:
I20260807 00:34:56.714243 9404 leader_election.cc:288] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:34:56.714277 9409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:56.714406 9409 raft_consensus.cc:686] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [term 1 LEADER]: Becoming Leader. State: Replica: a75870fb30a44e059dca36419d8f36b4, State: Running, Role: LEADER
I20260807 00:34:56.714563 9404 sys_catalog.cc:564] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:34:56.714560 9409 consensus_queue.cc:237] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75870fb30a44e059dca36419d8f36b4" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42659 } }
I20260807 00:34:56.715152 9411 sys_catalog.cc:455] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a75870fb30a44e059dca36419d8f36b4. Latest consensus state: current_term: 1 leader_uuid: "a75870fb30a44e059dca36419d8f36b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75870fb30a44e059dca36419d8f36b4" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42659 } } }
I20260807 00:34:56.715261 9411 sys_catalog.cc:458] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:56.715493 9410 sys_catalog.cc:455] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a75870fb30a44e059dca36419d8f36b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a75870fb30a44e059dca36419d8f36b4" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42659 } } }
I20260807 00:34:56.715837 9410 sys_catalog.cc:458] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:56.716082 9418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:34:56.716696 9418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:34:56.718591 9418 catalog_manager.cc:1347] Generated new cluster ID: 715bfe8b7e614050b197bc2167f72bd0
I20260807 00:34:56.718673 9418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:34:56 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:56.724015 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:56.711012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37850 (local address 127.7.252.62:42659)
0807 00:34:56.711336 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:56.711345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:56.711377 (+ 32us) server_negotiation.cc:407] Connection header received
0807 00:34:56.712628 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:56.712637 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:56.712703 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:56.712908 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:56.713738 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.715233 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.716546 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.717089 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.717229 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:56.720251 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:56.720255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:56.720256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:56.720270 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:56.722203 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:56.722704 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:56.722708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:56.722709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:56.722836 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:56.723084 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:56.723085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:56.723085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:56.723372 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:56.723581 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:56.723657 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 00:34:56.723826 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":90,"threads_started":1}
I20260807 00:34:56.746817 9418 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:34:56.747505 9418 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:34:56.757663 9418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: Generated new TSK 0
I20260807 00:34:56.757889 9418 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:34:56.794011 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:42659
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:56.883807 9431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:56.884028 9431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:56.884054 9431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:56.885340 9431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:56.885385 9431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:56.885406 9431 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:34:56.885423 9431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:34:56.886991 9431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:42659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:56.887269 9431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:56.887521 9431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:34:56.893049 9431 server_base.cc:1034] running on GCE node
W20260807 00:34:56.893028 9436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:56.893023 9437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:56.893028 9439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:56.893592 9431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:56.893891 9431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:56.895095 9431 hybrid_clock.cc:648] HybridClock initialized: now 1786062896895066 us; error 58 us; skew 500 ppm
Aug 07 00:34:56 dist-test-slave-csg5 krb5kdc[9311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062896, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:56.898131 9431 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:34:56.898797 9431 webserver.cc:460] Webserver started at http://127.7.252.1:43279/ using document root <none> and password file <none>
I20260807 00:34:56.899082 9431 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:56.899161 9431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:56.899341 9431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:56.900677 9431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "e28b20609fdf44798911c7ce335ce17c"
format_stamp: "Formatted at 2026-08-07 00:34:56 on dist-test-slave-csg5"
server_key: "e528025a5b6c125eaf788cf567fa2d65"
server_key_iv: "616cb4fa236f40567ea4f76b47a46889"
server_key_version: "encryptionkey@0"
I20260807 00:34:56.901089 9431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "e28b20609fdf44798911c7ce335ce17c"
format_stamp: "Formatted at 2026-08-07 00:34:56 on dist-test-slave-csg5"
server_key: "e528025a5b6c125eaf788cf567fa2d65"
server_key_iv: "616cb4fa236f40567ea4f76b47a46889"
server_key_version: "encryptionkey@0"
I20260807 00:34:56.902746 9431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260807 00:34:56.903644 9446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:56.903887 9431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:56.904007 9431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "e28b20609fdf44798911c7ce335ce17c"
format_stamp: "Formatted at 2026-08-07 00:34:56 on dist-test-slave-csg5"
server_key: "e528025a5b6c125eaf788cf567fa2d65"
server_key_iv: "616cb4fa236f40567ea4f76b47a46889"
server_key_version: "encryptionkey@0"
I20260807 00:34:56.904103 9431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:56.922109 9431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:56.925025 9431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:56.925348 9431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:56.925949 9431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:56.926017 9431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:56.926066 9431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:56.926098 9431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 00:34:56 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062896, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:56.934412 9431 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:35669
I20260807 00:34:56.934794 9569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:35669 every 8 connection(s)
I20260807 00:34:56.934937 9431 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:34:56.938463 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:56.926873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:38797 (local address 127.7.252.62:42659)
0807 00:34:56.926924 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:56.926926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:56.927392 (+ 466us) server_negotiation.cc:407] Connection header received
0807 00:34:56.928211 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:56.928213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:56.928227 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:56.928286 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:56.929339 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.930403 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.931730 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.932159 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.932254 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:56.935001 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:56.935002 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:56.935003 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:56.935015 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:56.936828 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:56.937324 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:56.937326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:56.937326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:56.937396 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:56.937691 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:56.937692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:56.937692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:56.937834 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:56.937915 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:56.938235 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 00:34:56.938357 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:34:56.938664 9455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:56.926802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.7.252.1:38797)
0807 00:34:56.927022 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:56.927063 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:56.928086 (+ 1023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:56.928392 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:56.928397 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:56.928861 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:56.929202 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:56.929209 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.930567 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.930568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:56.931612 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:56.931615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.932274 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.932275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:56.932412 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:56.933109 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:56.933119 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:56.934896 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:56.936950 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:56.936959 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:56.936961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:56.937219 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:56.937472 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:56.937473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:56.937473 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:56.937607 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:56.937917 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:56.937926 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:56.938082 (+ 156us) client_negotiation.cc:769] Sending connection context
0807 00:34:56.938193 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 00:34:56.938383 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":119,"threads_started":1}
I20260807 00:34:56.939306 9570 heartbeater.cc:347] Connected to a master server at 127.7.252.62:42659
I20260807 00:34:56.939409 9570 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:56.939636 9570 heartbeater.cc:511] Master 127.7.252.62:42659 requested a full tablet report, sending...
I20260807 00:34:56.940245 9358 ts_manager.cc:194] Registered new tserver with Master: e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669)
I20260807 00:34:56.940480 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 9431
I20260807 00:34:56.940585 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:34:56.940788 8176 external_mini_cluster.cc:1428] Setting key cf022870714638748552a6df4dd0074f
I20260807 00:34:56.941388 9358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:38797
I20260807 00:34:56.949486 9578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:56.940656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.7.252.1:45327)
0807 00:34:56.940844 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:56.940859 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:56.940924 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:56.941541 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:56.941543 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:56.942906 (+ 1363us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:56.942971 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:56.942973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.943931 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.943932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:56.944515 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:56.944517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.945054 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.945055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:56.945126 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:56.945710 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:56.945715 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:56.946053 (+ 338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:56.948240 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:56.948242 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:56.948242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:56.948442 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:56.948684 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:56.948685 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:56.948685 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:56.948746 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:56.949063 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:56.949063 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:56.949161 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 00:34:56.949238 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 00:34:56.949372 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
I20260807 00:34:56.949517 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:56.940987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:45327 (local address 127.7.252.62:42659)
0807 00:34:56.941038 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:56.941040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:56.941049 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:34:56.941072 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:56.941072 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:56.941083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:56.941178 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:56.943066 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.943817 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.944614 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:56.944956 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:56.945028 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:56.946157 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:56.946159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:56.946159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:56.946168 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:56.948141 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:56.948526 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:56.948528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:56.948529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:56.948601 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:56.948825 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:56.948826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:56.948827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:56.948987 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:56.949069 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:56.949295 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 00:34:56.949400 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:34:56.975335 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:42659
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:57.063128 9581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:57.063390 9581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:57.063431 9581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:57.064636 9581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:57.064711 9581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:57.064746 9581 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:34:57.064785 9581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:34:57.066287 9581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:42659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:57.066571 9581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:57.066845 9581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:57.072715 9591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:57.072737 9588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:57.072715 9587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:57.073058 9581 server_base.cc:1034] running on GCE node
I20260807 00:34:57.073318 9581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:57.073601 9581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:57.074759 9581 hybrid_clock.cc:648] HybridClock initialized: now 1786062897074721 us; error 57 us; skew 500 ppm
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:57.077833 9581 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:34:57.078336 9581 webserver.cc:460] Webserver started at http://127.7.252.2:34745/ using document root <none> and password file <none>
I20260807 00:34:57.078593 9581 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:57.078692 9581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:57.078869 9581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:57.080008 9581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a"
format_stamp: "Formatted at 2026-08-07 00:34:57 on dist-test-slave-csg5"
server_key: "b960346812264b921b9846fa32236c7d"
server_key_iv: "85d6c13a4ea927c6561e69d7e9b8e135"
server_key_version: "encryptionkey@0"
I20260807 00:34:57.080386 9581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a"
format_stamp: "Formatted at 2026-08-07 00:34:57 on dist-test-slave-csg5"
server_key: "b960346812264b921b9846fa32236c7d"
server_key_iv: "85d6c13a4ea927c6561e69d7e9b8e135"
server_key_version: "encryptionkey@0"
I20260807 00:34:57.081836 9581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:34:57.082721 9600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.082933 9581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:34:57.083036 9581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a"
format_stamp: "Formatted at 2026-08-07 00:34:57 on dist-test-slave-csg5"
server_key: "b960346812264b921b9846fa32236c7d"
server_key_iv: "85d6c13a4ea927c6561e69d7e9b8e135"
server_key_version: "encryptionkey@0"
I20260807 00:34:57.083120 9581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:57.091713 9581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:57.094200 9581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:57.094379 9581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:57.095017 9581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:57.095091 9581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.095137 9581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:57.095163 9581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.102825 9581 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:41599
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:57.102931 9723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:41599 every 8 connection(s)
I20260807 00:34:57.103299 9581 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:34:57.106725 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.095578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:43923 (local address 127.7.252.62:42659)
0807 00:34:57.095630 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.095633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.095856 (+ 223us) server_negotiation.cc:407] Connection header received
0807 00:34:57.096565 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.096567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.096582 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.096652 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.097640 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.098627 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.099926 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.100285 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.100371 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.103618 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.103619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.103620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.103628 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.105100 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.105625 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.105626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.105626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.105686 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.105947 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.105949 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.105949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.106096 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.106177 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.106544 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.106634 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:34:57.107051 9609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.095523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.7.252.2:43923)
0807 00:34:57.095703 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.095756 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.096398 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.096764 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.096770 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.097220 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:57.097525 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.097533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.098777 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.098779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.099815 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.099817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.100388 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.100389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.100560 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.101337 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:57.101346 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:57.103489 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:57.105319 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.105325 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.105327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.105550 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.105752 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.105752 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.105753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.105855 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.106267 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:57.106272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:57.106398 (+ 126us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.106488 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.106616 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260807 00:34:57.107617 9724 heartbeater.cc:347] Connected to a master server at 127.7.252.62:42659
I20260807 00:34:57.107746 9724 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:57.107952 9724 heartbeater.cc:511] Master 127.7.252.62:42659 requested a full tablet report, sending...
I20260807 00:34:57.108407 9358 ts_manager.cc:194] Registered new tserver with Master: ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599)
I20260807 00:34:57.109001 9358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:43923
I20260807 00:34:57.112036 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 9581
I20260807 00:34:57.112156 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:34:57.112429 8176 external_mini_cluster.cc:1428] Setting key 934a1e42380c61b831b26cd018094657
I20260807 00:34:57.116154 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.109078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.7.252.2:41273)
0807 00:34:57.109348 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.109364 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.109449 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.109588 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.109589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.109802 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:57.109862 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.109863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.110584 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.110585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.111224 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.111226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.111630 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.111631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.111719 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.112319 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:57.112323 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:57.112773 (+ 450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:57.114785 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.114786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.114786 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.115019 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.115335 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.115336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.115337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.115409 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.115760 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:57.115761 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:57.115815 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.115915 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.116037 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":189,"threads_started":1}
I20260807 00:34:57.116170 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.109192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:41273 (local address 127.7.252.62:42659)
0807 00:34:57.109247 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.109249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.109431 (+ 182us) server_negotiation.cc:407] Connection header received
0807 00:34:57.109505 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.109506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.109519 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.109569 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.109959 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.110481 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.111330 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.111550 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.111631 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.112871 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.112872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.112873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.112881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.114648 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.115119 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.115121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.115121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.115266 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.115488 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.115489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.115489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.115659 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.115744 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.115943 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.116067 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:34:57.142868 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:42659
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:57.236979 9733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:57.237380 9733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:57.237434 9733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:57.239059 9733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:57.239140 9733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:57.239189 9733 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:34:57.239254 9733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:34:57.241057 9733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:42659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:57.241384 9733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:57.241655 9733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:57.247705 9742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:57.247839 9733 server_base.cc:1034] running on GCE node
W20260807 00:34:57.247718 9739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:57.247732 9740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:57.248227 9733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:57.248575 9733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:57.249786 9733 hybrid_clock.cc:648] HybridClock initialized: now 1786062897249781 us; error 39 us; skew 500 ppm
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:57.252962 9733 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:34:57.253521 9733 webserver.cc:460] Webserver started at http://127.7.252.3:37449/ using document root <none> and password file <none>
I20260807 00:34:57.253778 9733 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:57.253854 9733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:57.254014 9733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:57.255342 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "aad866f94c4c41f2abd61724d6360883"
format_stamp: "Formatted at 2026-08-07 00:34:57 on dist-test-slave-csg5"
server_key: "08d905e0ca8b9d92319ba7c7f61ce00c"
server_key_iv: "cee89b6123255a723b0b53e017a88fab"
server_key_version: "encryptionkey@0"
I20260807 00:34:57.255738 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "aad866f94c4c41f2abd61724d6360883"
format_stamp: "Formatted at 2026-08-07 00:34:57 on dist-test-slave-csg5"
server_key: "08d905e0ca8b9d92319ba7c7f61ce00c"
server_key_iv: "cee89b6123255a723b0b53e017a88fab"
server_key_version: "encryptionkey@0"
I20260807 00:34:57.257182 9733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:34:57.258188 9752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.258487 9733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:57.258631 9733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "aad866f94c4c41f2abd61724d6360883"
format_stamp: "Formatted at 2026-08-07 00:34:57 on dist-test-slave-csg5"
server_key: "08d905e0ca8b9d92319ba7c7f61ce00c"
server_key_iv: "cee89b6123255a723b0b53e017a88fab"
server_key_version: "encryptionkey@0"
I20260807 00:34:57.258782 9733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:57.269142 9733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:57.271730 9733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:57.271924 9733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:57.272601 9733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:57.272681 9733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.272718 9733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:57.272742 9733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:57.281323 9733 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:46479
I20260807 00:34:57.281406 9874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:46479 every 8 connection(s)
I20260807 00:34:57.281760 9733 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:34:57.282789 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.273016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:41687 (local address 127.7.252.62:42659)
0807 00:34:57.273081 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.273083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.273291 (+ 208us) server_negotiation.cc:407] Connection header received
0807 00:34:57.273868 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.273869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.273883 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.273935 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.274584 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.275152 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.276333 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.276537 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.276618 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.279530 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.279531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.279531 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.279540 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.281152 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.281647 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.281649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.281649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.281716 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.281984 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.281985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.281985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.282162 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.282232 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.282531 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.282619 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 00:34:57.282884 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.273009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.7.252.3:41687)
0807 00:34:57.273158 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.273194 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.273732 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.274007 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.274023 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.274263 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:57.274461 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.274466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.275264 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.275265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.276214 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.276217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.276626 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.276627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.276767 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.277421 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:57.277435 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:57.279414 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:57.281232 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.281236 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.281238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.281552 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.281786 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.281787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.281788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.281928 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.282261 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:57.282266 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:57.282400 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.282486 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.282616 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
I20260807 00:34:57.283509 9875 heartbeater.cc:347] Connected to a master server at 127.7.252.62:42659
I20260807 00:34:57.283594 9875 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:57.283816 9875 heartbeater.cc:511] Master 127.7.252.62:42659 requested a full tablet report, sending...
I20260807 00:34:57.284300 9357 ts_manager.cc:194] Registered new tserver with Master: aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479)
I20260807 00:34:57.284902 9357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:41687
I20260807 00:34:57.289254 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 9733
I20260807 00:34:57.289355 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:34:57.289511 8176 external_mini_cluster.cc:1428] Setting key 22f32fcae0a1b7b81bb18deddc36ca26
I20260807 00:34:57.290584 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:34:57.292259 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.284601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.7.252.3:44935)
0807 00:34:57.284720 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.284731 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.284784 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.285226 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.285227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.285464 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:57.285534 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.285536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.286375 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.286375 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.286995 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.286997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.287543 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.287544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.287626 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.288155 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:57.288160 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:57.288467 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:57.290613 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.290614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.290615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.290893 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.291239 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.291240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.291241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.291342 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.291811 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:57.291813 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:57.291881 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.291981 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.292118 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
I20260807 00:34:57.292322 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.284682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:44935 (local address 127.7.252.62:42659)
0807 00:34:57.285066 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.285069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.285079 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:57.285103 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.285104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.285115 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.285221 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.285670 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.286224 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.287126 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.287412 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.287497 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.288569 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.288570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.288570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.288577 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.290538 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.290997 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.290998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.290999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.291107 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.291475 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.291477 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.291477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.291724 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.291824 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.292035 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.292182 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358}
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:57.317755 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.309818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37854 (local address 127.7.252.62:42659)
0807 00:34:57.309913 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.309916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.309928 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:34:57.309958 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.309959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.309971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.310038 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.310755 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.311273 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.312047 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.312246 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.312324 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.314822 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.314823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.314824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.314832 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.316337 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.316784 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.316785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.316785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.316842 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.317022 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.317023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.317023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.317130 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.317212 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.317443 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.317513 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 00:34:57.319995 9357 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:34:57.321938 9357 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:34:57.329353 9899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.324842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:46479 (local address 127.0.0.1:38502)
0807 00:34:57.325411 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.325422 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.325504 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.325858 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.325859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.325861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.325905 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.325906 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.327096 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.327097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.328056 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.328058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.329008 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.329009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.329094 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.329108 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.329187 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.329248 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":99,"threads_started":1}
I20260807 00:34:57.329376 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.325226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.7.252.3:46479)
0807 00:34:57.325630 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.325635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.325645 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:57.325683 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.325685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.325701 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.325776 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.325985 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.327006 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.328144 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.328910 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.328991 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.329067 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.329218 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.329264 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":84,"threads_started":1}
I20260807 00:34:57.329563 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.324947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47472 (local address 127.7.252.2:41599)
0807 00:34:57.325186 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.325190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.325200 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:57.325243 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.325245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.325260 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.325330 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.325642 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.326798 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.328284 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.328977 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.329036 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.329083 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.329421 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.329460 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":112,"threads_started":1}
I20260807 00:34:57.329587 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.325195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36568 (local address 127.7.252.1:35669)
0807 00:34:57.325383 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.325387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.326051 (+ 664us) server_negotiation.cc:407] Connection header received
0807 00:34:57.326120 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.326125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.326143 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.326227 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.326325 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.327236 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.328463 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.328993 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.329064 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.329122 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.329420 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.329469 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260807 00:34:57.329380 9896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.325061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:35669 (local address 127.0.0.1:36568)
0807 00:34:57.325980 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.325988 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.326046 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.326224 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.326226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.326227 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.326265 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.326266 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.327347 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.327348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.328380 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.328381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.329156 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.329157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.329232 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.329235 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.329281 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.329315 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":1,"thread_start_us":73,"threads_started":1}
I20260807 00:34:57.330020 9897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.324812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:41599 (local address 127.0.0.1:47472)
0807 00:34:57.325004 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.325054 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.325128 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.325434 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.325438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.325441 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.325513 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.325515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.326885 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.326886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.328198 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.328201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.329118 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.329119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.329245 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.329250 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.329303 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.329348 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":3,"thread_start_us":62,"threads_started":1}
I20260807 00:34:57.330618 9806 tablet_service.cc:1467] Processing CreateTablet for tablet 7ed6e32672a64a4f836ea89880bb733d (DEFAULT_TABLE table=test-table [id=20888560071448ea8a148e5ee9c96750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:57.330607 9500 tablet_service.cc:1467] Processing CreateTablet for tablet 7ed6e32672a64a4f836ea89880bb733d (DEFAULT_TABLE table=test-table [id=20888560071448ea8a148e5ee9c96750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:57.330639 9651 tablet_service.cc:1467] Processing CreateTablet for tablet 7ed6e32672a64a4f836ea89880bb733d (DEFAULT_TABLE table=test-table [id=20888560071448ea8a148e5ee9c96750]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:57.331017 9500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ed6e32672a64a4f836ea89880bb733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.331022 9651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ed6e32672a64a4f836ea89880bb733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.331022 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ed6e32672a64a4f836ea89880bb733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.334045 9902 tablet_bootstrap.cc:492] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Bootstrap starting.
I20260807 00:34:57.334688 9904 tablet_bootstrap.cc:492] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Bootstrap starting.
I20260807 00:34:57.334802 9902 tablet_bootstrap.cc:654] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.335055 9903 tablet_bootstrap.cc:492] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Bootstrap starting.
I20260807 00:34:57.335184 9902 log.cc:824] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:57.335398 9904 tablet_bootstrap.cc:654] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.335768 9904 log.cc:824] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:57.335978 9902 tablet_bootstrap.cc:492] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: No bootstrap required, opened a new log
I20260807 00:34:57.336042 9903 tablet_bootstrap.cc:654] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.336057 9902 ts_tablet_manager.cc:1397] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:34:57.336367 9903 log.cc:824] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:57.336659 9904 tablet_bootstrap.cc:492] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: No bootstrap required, opened a new log
I20260807 00:34:57.336738 9904 ts_tablet_manager.cc:1397] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:34:57.337093 9903 tablet_bootstrap.cc:492] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: No bootstrap required, opened a new log
I20260807 00:34:57.337181 9903 ts_tablet_manager.cc:1397] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:34:57.338259 9902 raft_consensus.cc:348] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.338444 9902 raft_consensus.cc:374] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.338480 9902 raft_consensus.cc:729] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28b20609fdf44798911c7ce335ce17c, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.338606 9902 consensus_queue.cc:260] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.338615 9903 raft_consensus.cc:348] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.338876 9903 raft_consensus.cc:374] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.338922 9903 raft_consensus.cc:729] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aad866f94c4c41f2abd61724d6360883, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.338939 9902 ts_tablet_manager.cc:1428] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:34:57.338824 9904 raft_consensus.cc:348] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.339022 9904 raft_consensus.cc:374] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.339064 9904 raft_consensus.cc:729] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb21a5c1c564fcd88d8f5f1a54c963a, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.339076 9570 heartbeater.cc:503] Master 127.7.252.62:42659 was elected leader, sending a full tablet report...
I20260807 00:34:57.339184 9904 consensus_queue.cc:260] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.339387 9903 consensus_queue.cc:260] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.339448 9904 ts_tablet_manager.cc:1428] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:34:57.339555 9724 heartbeater.cc:503] Master 127.7.252.62:42659 was elected leader, sending a full tablet report...
I20260807 00:34:57.339661 9903 ts_tablet_manager.cc:1428] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:34:57.339708 9875 heartbeater.cc:503] Master 127.7.252.62:42659 was elected leader, sending a full tablet report...
W20260807 00:34:57.353978 9725 tablet.cc:2369] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:34:57.403065 9908 raft_consensus.cc:482] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:34:57.403204 9908 raft_consensus.cc:504] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.403513 9908 leader_election.cc:288] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479), ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599)
I20260807 00:34:57.406936 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.403874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:59745 (local address 127.7.252.2:41599)
0807 00:34:57.403922 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.403925 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.404278 (+ 353us) server_negotiation.cc:407] Connection header received
0807 00:34:57.404354 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.404355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.404367 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.404442 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.404603 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.405069 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.406129 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.406496 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.406595 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.406606 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.406831 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.406874 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:34:57.406946 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.403782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:41599 (local address 127.7.252.1:59745)
0807 00:34:57.404190 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.404199 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.404279 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.404446 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.404447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.404449 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.404531 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.404533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.405166 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.405167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.406022 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.406025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.406601 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.406602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.406728 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.406738 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.406799 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.406842 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":213,"thread_start_us":125,"threads_started":1}
I20260807 00:34:57.407016 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.403919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:42227 (local address 127.7.252.3:46479)
0807 00:34:57.404007 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.404009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.404016 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:34:57.404043 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.404044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.404054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.404116 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.404406 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.404997 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.406137 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.406577 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.406692 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.406703 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.406888 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.406929 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 00:34:57.407068 9455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.403782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:46479 (local address 127.7.252.1:42227)
0807 00:34:57.403831 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.403846 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.403896 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.404152 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.404153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.404156 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.404306 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.404308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.405098 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.405100 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.406031 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.406033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.406699 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.406700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.406793 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.406796 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.406867 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.406931 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":33}
I20260807 00:34:57.407521 9674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ed6e32672a64a4f836ea89880bb733d" candidate_uuid: "e28b20609fdf44798911c7ce335ce17c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" is_pre_election: true
I20260807 00:34:57.407557 9825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ed6e32672a64a4f836ea89880bb733d" candidate_uuid: "e28b20609fdf44798911c7ce335ce17c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aad866f94c4c41f2abd61724d6360883" is_pre_election: true
I20260807 00:34:57.407706 9674 raft_consensus.cc:2454] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28b20609fdf44798911c7ce335ce17c in term 0.
I20260807 00:34:57.407778 9825 raft_consensus.cc:2454] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28b20609fdf44798911c7ce335ce17c in term 0.
I20260807 00:34:57.407989 9447 leader_election.cc:302] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e28b20609fdf44798911c7ce335ce17c, ebb21a5c1c564fcd88d8f5f1a54c963a; no voters:
I20260807 00:34:57.408143 9908 raft_consensus.cc:2781] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:34:57.408223 9908 raft_consensus.cc:482] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:34:57.408267 9908 raft_consensus.cc:3037] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.409065 9908 raft_consensus.cc:504] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.409224 9908 leader_election.cc:288] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [CANDIDATE]: Term 1 election: Requested vote from peers aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479), ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599)
I20260807 00:34:57.409402 9674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ed6e32672a64a4f836ea89880bb733d" candidate_uuid: "e28b20609fdf44798911c7ce335ce17c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a"
I20260807 00:34:57.409417 9825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ed6e32672a64a4f836ea89880bb733d" candidate_uuid: "e28b20609fdf44798911c7ce335ce17c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aad866f94c4c41f2abd61724d6360883"
I20260807 00:34:57.409494 9674 raft_consensus.cc:3037] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.409493 9825 raft_consensus.cc:3037] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.410478 9825 raft_consensus.cc:2454] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28b20609fdf44798911c7ce335ce17c in term 1.
I20260807 00:34:57.410478 9674 raft_consensus.cc:2454] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28b20609fdf44798911c7ce335ce17c in term 1.
I20260807 00:34:57.410745 9447 leader_election.cc:302] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e28b20609fdf44798911c7ce335ce17c, ebb21a5c1c564fcd88d8f5f1a54c963a; no voters:
I20260807 00:34:57.410861 9908 raft_consensus.cc:2781] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:57.411033 9908 raft_consensus.cc:686] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 1 LEADER]: Becoming Leader. State: Replica: e28b20609fdf44798911c7ce335ce17c, State: Running, Role: LEADER
I20260807 00:34:57.411175 9908 consensus_queue.cc:237] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } }
I20260807 00:34:57.412114 9357 catalog_manager.cc:5495] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c reported cstate change: term changed from 0 to 1, leader changed from <none> to e28b20609fdf44798911c7ce335ce17c (127.7.252.1). New cstate: current_term: 1 leader_uuid: "e28b20609fdf44798911c7ce335ce17c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } health_report { overall_health: HEALTHY } } }
I20260807 00:34:57.423256 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.420647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60192 (local address 127.7.252.1:35669)
0807 00:34:57.420715 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.420717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.420723 (+ 6us) server_negotiation.cc:407] Connection header received
0807 00:34:57.420756 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.420756 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.420776 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.420844 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:34:57.421024 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.421501 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.422318 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.422519 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.422599 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.422872 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.422970 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.423062 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.423116 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.423140 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 00:34:57.425746 9674 raft_consensus.cc:1261] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Refusing update from remote peer e28b20609fdf44798911c7ce335ce17c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:34:57.426163 9912 consensus_queue.cc:1035] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:34:57.427945 9825 raft_consensus.cc:1261] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Refusing update from remote peer e28b20609fdf44798911c7ce335ce17c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:34:57.428267 9908 consensus_queue.cc:1035] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:34:57.428620 9915 mvcc.cc:205] Tried to move back new op lower bound from 7315713627852369920 to 7315713627796811776. Current Snapshot: MvccSnapshot[applied={T|T < 7315713627852369920}]
I20260807 00:34:57.429176 9917 mvcc.cc:205] Tried to move back new op lower bound from 7315713627852369920 to 7315713627796811776. Current Snapshot: MvccSnapshot[applied={T|T < 7315713627852369920}]
I20260807 00:34:57.429692 9922 mvcc.cc:205] Tried to move back new op lower bound from 7315713627852369920 to 7315713627796811776. Current Snapshot: MvccSnapshot[applied={T|T < 7315713627852369920}]
I20260807 00:34:57.434082 9358 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:34:57.434185 9358 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:34:57.435268 9358 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: Sending DeleteTablet for 3 replicas of tablet 7ed6e32672a64a4f836ea89880bb733d
I20260807 00:34:57.435719 9651 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ed6e32672a64a4f836ea89880bb733d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:34:57 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:47472
I20260807 00:34:57.435698 9806 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ed6e32672a64a4f836ea89880bb733d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:34:57 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:38502
I20260807 00:34:57.435880 9500 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ed6e32672a64a4f836ea89880bb733d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:34:57 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36568
I20260807 00:34:57.436439 9928 tablet_replica.cc:330] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: stopping tablet replica
I20260807 00:34:57.436446 9358 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 00:34:57.436630 9928 raft_consensus.cc:2229] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 00:34:57.436669 9358 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:34:57.436821 9928 raft_consensus.cc:2258] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:34:57.437012 9927 tablet_replica.cc:330] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: stopping tablet replica
I20260807 00:34:57.437134 9927 raft_consensus.cc:2229] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:34:57.437281 9927 raft_consensus.cc:2258] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:34:57.437732 9929 tablet_replica.cc:330] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: stopping tablet replica
I20260807 00:34:57.437943 9929 raft_consensus.cc:2229] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:34:57.437960 9928 ts_tablet_manager.cc:1905] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:34:57.438297 9927 ts_tablet_manager.cc:1905] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:34:57.438539 9929 raft_consensus.cc:2258] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:34:57.439039 9651 tablet_service.cc:1467] Processing CreateTablet for tablet 954255937f7b43c5a606211f64d0f792 (DEFAULT_TABLE table=test-table [id=49b0b5ec462e4ff3aab8c978d275c52d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:57.439254 9806 tablet_service.cc:1467] Processing CreateTablet for tablet 954255937f7b43c5a606211f64d0f792 (DEFAULT_TABLE table=test-table [id=49b0b5ec462e4ff3aab8c978d275c52d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:57.439373 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954255937f7b43c5a606211f64d0f792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.439416 9651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954255937f7b43c5a606211f64d0f792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.440598 9904 tablet_bootstrap.cc:492] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Bootstrap starting.
I20260807 00:34:57.440914 9903 tablet_bootstrap.cc:492] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Bootstrap starting.
I20260807 00:34:57.441105 9904 tablet_bootstrap.cc:654] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.439218 9500 tablet_service.cc:1467] Processing CreateTablet for tablet 954255937f7b43c5a606211f64d0f792 (DEFAULT_TABLE table=test-table [id=49b0b5ec462e4ff3aab8c978d275c52d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:34:57.441322 9500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 954255937f7b43c5a606211f64d0f792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.441497 9903 tablet_bootstrap.cc:654] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.442358 9903 tablet_bootstrap.cc:492] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: No bootstrap required, opened a new log
I20260807 00:34:57.442435 9903 ts_tablet_manager.cc:1397] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:34:57.442620 9903 raft_consensus.cc:348] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.442730 9903 raft_consensus.cc:374] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.442755 9903 raft_consensus.cc:729] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aad866f94c4c41f2abd61724d6360883, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.442811 9903 consensus_queue.cc:260] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.442890 9902 tablet_bootstrap.cc:492] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Bootstrap starting.
I20260807 00:34:57.442920 9903 ts_tablet_manager.cc:1428] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.443425 9902 tablet_bootstrap.cc:654] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.443516 9928 ts_tablet_manager.cc:1918] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:34:57.443600 9928 log.cc:1196] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/7ed6e32672a64a4f836ea89880bb733d
I20260807 00:34:57.443909 9928 ts_tablet_manager.cc:1939] T 7ed6e32672a64a4f836ea89880bb733d P ebb21a5c1c564fcd88d8f5f1a54c963a: Deleting consensus metadata
I20260807 00:34:57.444190 9929 ts_tablet_manager.cc:1905] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:34:57.444377 9340 catalog_manager.cc:4841] TS ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599): tablet 7ed6e32672a64a4f836ea89880bb733d (table test-table [id=20888560071448ea8a148e5ee9c96750]) successfully deleted
I20260807 00:34:57.444618 9902 tablet_bootstrap.cc:492] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: No bootstrap required, opened a new log
I20260807 00:34:57.444680 9902 ts_tablet_manager.cc:1397] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260807 00:34:57.444866 9902 raft_consensus.cc:348] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.444972 9902 raft_consensus.cc:374] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.444998 9902 raft_consensus.cc:729] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28b20609fdf44798911c7ce335ce17c, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.445039 9904 tablet_bootstrap.cc:492] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: No bootstrap required, opened a new log
I20260807 00:34:57.445046 9902 consensus_queue.cc:260] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.445082 9904 ts_tablet_manager.cc:1397] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 00:34:57.445168 9902 ts_tablet_manager.cc:1428] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.445282 9904 raft_consensus.cc:348] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.445359 9904 raft_consensus.cc:374] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.445384 9904 raft_consensus.cc:729] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb21a5c1c564fcd88d8f5f1a54c963a, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.445427 9904 consensus_queue.cc:260] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.445519 9904 ts_tablet_manager.cc:1428] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 00:34:57.445991 9929 ts_tablet_manager.cc:1918] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:34:57.446076 9929 log.cc:1196] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/7ed6e32672a64a4f836ea89880bb733d
I20260807 00:34:57.446357 9929 ts_tablet_manager.cc:1939] T 7ed6e32672a64a4f836ea89880bb733d P e28b20609fdf44798911c7ce335ce17c: Deleting consensus metadata
I20260807 00:34:57.446568 9927 ts_tablet_manager.cc:1918] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:34:57.446682 9927 log.cc:1196] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/7ed6e32672a64a4f836ea89880bb733d
I20260807 00:34:57.446970 9927 ts_tablet_manager.cc:1939] T 7ed6e32672a64a4f836ea89880bb733d P aad866f94c4c41f2abd61724d6360883: Deleting consensus metadata
I20260807 00:34:57.447453 9344 catalog_manager.cc:4841] TS aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479): tablet 7ed6e32672a64a4f836ea89880bb733d (table test-table [id=20888560071448ea8a148e5ee9c96750]) successfully deleted
I20260807 00:34:57.447626 9344 catalog_manager.cc:4841] TS e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669): tablet 7ed6e32672a64a4f836ea89880bb733d (table test-table [id=20888560071448ea8a148e5ee9c96750]) successfully deleted
I20260807 00:34:57.501570 9910 raft_consensus.cc:482] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:34:57.501695 9910 raft_consensus.cc:504] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.502096 9910 leader_election.cc:288] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669), ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599)
I20260807 00:34:57.506217 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.502486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:49243 (local address 127.7.252.1:35669)
0807 00:34:57.502531 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.502533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.502686 (+ 153us) server_negotiation.cc:407] Connection header received
0807 00:34:57.502830 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.502831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.502841 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.502916 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.503117 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.503875 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.505246 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.505804 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.505904 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.505918 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.506103 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.506143 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:34:57.506242 9933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.502384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:35669 (local address 127.7.252.3:49243)
0807 00:34:57.502610 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.502619 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.502708 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.502920 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.502921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.502923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.503025 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.503027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.503973 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.503973 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.505113 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.505116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.505931 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.505932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.506011 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.506016 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.506073 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.506118 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":100,"thread_start_us":68,"threads_started":1}
I20260807 00:34:57.506623 9521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954255937f7b43c5a606211f64d0f792" candidate_uuid: "aad866f94c4c41f2abd61724d6360883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28b20609fdf44798911c7ce335ce17c" is_pre_election: true
I20260807 00:34:57.506832 9521 raft_consensus.cc:2454] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aad866f94c4c41f2abd61724d6360883 in term 0.
I20260807 00:34:57.506958 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.502384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:41599 (local address 127.7.252.3:39597)
0807 00:34:57.502460 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.502473 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.502527 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.502977 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.502977 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.502979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.503029 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.503030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.504824 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.504825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.505710 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.505713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.506620 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.506621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.506740 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.506744 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.506819 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.506872 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 00:34:57.507045 9757 leader_election.cc:302] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aad866f94c4c41f2abd61724d6360883, e28b20609fdf44798911c7ce335ce17c; no voters:
I20260807 00:34:57.507099 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.502579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:39597 (local address 127.7.252.2:41599)
0807 00:34:57.502621 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.502623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.502632 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:34:57.502686 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.502687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.502697 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.502934 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.503995 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.504707 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.505871 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.506501 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.506571 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.506585 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.506984 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.507032 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:34:57.507191 9910 raft_consensus.cc:2781] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:34:57.507229 9910 raft_consensus.cc:482] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:34:57.507256 9910 raft_consensus.cc:3037] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.507380 9674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954255937f7b43c5a606211f64d0f792" candidate_uuid: "aad866f94c4c41f2abd61724d6360883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" is_pre_election: true
I20260807 00:34:57.507483 9674 raft_consensus.cc:2454] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aad866f94c4c41f2abd61724d6360883 in term 0.
I20260807 00:34:57.508291 9910 raft_consensus.cc:504] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.508482 9910 leader_election.cc:288] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [CANDIDATE]: Term 1 election: Requested vote from peers e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669), ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599)
I20260807 00:34:57.508632 9521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954255937f7b43c5a606211f64d0f792" candidate_uuid: "aad866f94c4c41f2abd61724d6360883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28b20609fdf44798911c7ce335ce17c"
I20260807 00:34:57.508715 9521 raft_consensus.cc:3037] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.508674 9674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "954255937f7b43c5a606211f64d0f792" candidate_uuid: "aad866f94c4c41f2abd61724d6360883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a"
I20260807 00:34:57.508761 9674 raft_consensus.cc:3037] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.509465 9521 raft_consensus.cc:2454] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aad866f94c4c41f2abd61724d6360883 in term 1.
I20260807 00:34:57.509701 9757 leader_election.cc:302] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aad866f94c4c41f2abd61724d6360883, e28b20609fdf44798911c7ce335ce17c; no voters:
I20260807 00:34:57.509794 9674 raft_consensus.cc:2454] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aad866f94c4c41f2abd61724d6360883 in term 1.
I20260807 00:34:57.509806 9910 raft_consensus.cc:2781] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:57.510004 9910 raft_consensus.cc:686] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 1 LEADER]: Becoming Leader. State: Replica: aad866f94c4c41f2abd61724d6360883, State: Running, Role: LEADER
I20260807 00:34:57.510089 9910 consensus_queue.cc:237] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.510854 9358 catalog_manager.cc:5495] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 reported cstate change: term changed from 0 to 1, leader changed from <none> to aad866f94c4c41f2abd61724d6360883 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "aad866f94c4c41f2abd61724d6360883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } health_report { overall_health: HEALTHY } } }
W20260807 00:34:57.532469 9876 tablet.cc:2369] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062896, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:57.551632 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.543684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40442 (local address 127.7.252.62:42659)
0807 00:34:57.543751 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.543754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.543865 (+ 111us) server_negotiation.cc:407] Connection header received
0807 00:34:57.543953 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.543954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.543966 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.544046 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.544641 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.545188 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.545938 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.546126 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.546237 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.548558 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.548560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.548560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.548567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.550144 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.550699 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.550700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.550701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.550764 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.550972 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.550973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.550974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.551090 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.551171 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.551335 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.551491 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":33}
I20260807 00:34:57.551702 9941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.543582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42659 (local address 127.0.0.1:40442)
0807 00:34:57.543767 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.543779 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.543883 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.544065 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.544065 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.544494 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:57.544549 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.544552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.545294 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.545295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.545847 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.545848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.546235 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.546236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.546308 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.546971 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:57.546976 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:57.548458 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:57.550360 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.550371 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.550374 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.550583 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.550834 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:57.550835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:57.550835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:57.550897 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:57.551169 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:57.551178 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:57.551231 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.551300 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.551551 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":117,"thread_start_us":96,"threads_started":1}
I20260807 00:34:57.554877 9358 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:40442:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 00:34:57.555141 9358 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:34:57.556845 9806 tablet_service.cc:1467] Processing CreateTablet for tablet 558047bb18fb43529921a0df5fc9fd93 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5f674d6afbe546e9a4598c43e3d84335]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:34:57.556842 9651 tablet_service.cc:1467] Processing CreateTablet for tablet 558047bb18fb43529921a0df5fc9fd93 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5f674d6afbe546e9a4598c43e3d84335]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:34:57.556905 9500 tablet_service.cc:1467] Processing CreateTablet for tablet 558047bb18fb43529921a0df5fc9fd93 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5f674d6afbe546e9a4598c43e3d84335]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:34:57.557025 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 558047bb18fb43529921a0df5fc9fd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.557026 9651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 558047bb18fb43529921a0df5fc9fd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.557032 9500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 558047bb18fb43529921a0df5fc9fd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:57.558605 9903 tablet_bootstrap.cc:492] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: Bootstrap starting.
I20260807 00:34:57.558607 9902 tablet_bootstrap.cc:492] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: Bootstrap starting.
I20260807 00:34:57.559079 9902 tablet_bootstrap.cc:654] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.559094 9903 tablet_bootstrap.cc:654] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.559435 9904 tablet_bootstrap.cc:492] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: Bootstrap starting.
I20260807 00:34:57.559880 9904 tablet_bootstrap.cc:654] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:57.560164 9903 tablet_bootstrap.cc:492] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: No bootstrap required, opened a new log
I20260807 00:34:57.560216 9903 ts_tablet_manager.cc:1397] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:34:57.560411 9903 raft_consensus.cc:348] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.560484 9903 raft_consensus.cc:374] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.560501 9903 raft_consensus.cc:729] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aad866f94c4c41f2abd61724d6360883, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.560546 9903 consensus_queue.cc:260] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.560645 9903 ts_tablet_manager.cc:1428] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:57.560708 9910 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.560774 9910 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:34:57.561203 9902 tablet_bootstrap.cc:492] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: No bootstrap required, opened a new log
I20260807 00:34:57.561276 9902 ts_tablet_manager.cc:1397] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 00:34:57.561432 9902 raft_consensus.cc:348] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.561529 9902 raft_consensus.cc:374] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.561559 9902 raft_consensus.cc:729] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28b20609fdf44798911c7ce335ce17c, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.561609 9902 consensus_queue.cc:260] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.561698 9902 ts_tablet_manager.cc:1428] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 00:34:57.561834 9912 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.561913 9912 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:34:57.562337 9904 tablet_bootstrap.cc:492] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: No bootstrap required, opened a new log
I20260807 00:34:57.562418 9904 ts_tablet_manager.cc:1397] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 00:34:57.562584 9904 raft_consensus.cc:348] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.562690 9904 raft_consensus.cc:374] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:57.562717 9904 raft_consensus.cc:729] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb21a5c1c564fcd88d8f5f1a54c963a, State: Initialized, Role: FOLLOWER
I20260807 00:34:57.562770 9904 consensus_queue.cc:260] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.562899 9904 ts_tablet_manager.cc:1428] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 00:34:57.562978 9909 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.563074 9909 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 00:34:57.686271 9571 tablet.cc:2369] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:34:57.812438 9909 raft_consensus.cc:482] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:34:57.812559 9909 raft_consensus.cc:504] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.812969 9909 leader_election.cc:288] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669), aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479)
I20260807 00:34:57.816783 9946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.813357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:46479 (local address 127.7.252.2:34489)
0807 00:34:57.813496 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.813506 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.813551 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.813718 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.813719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.813721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.813800 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.813802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.814571 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.814572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.815766 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.815769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.816430 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.816431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.816506 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.816517 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.816588 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.816635 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":34,"thread_start_us":67,"threads_started":1}
I20260807 00:34:57.816745 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.813465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:34489 (local address 127.7.252.3:46479)
0807 00:34:57.813551 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.813554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.813564 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:57.813619 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.813621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.813630 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.813720 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.813876 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.814467 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.815869 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.816321 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.816428 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.816441 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.816593 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.816639 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 00:34:57.816773 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.813253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:42641 (local address 127.7.252.1:35669)
0807 00:34:57.813404 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.813407 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.813422 (+ 15us) server_negotiation.cc:407] Connection header received
0807 00:34:57.813498 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.813499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.813515 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.813601 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:57.813811 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.814464 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.815902 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.816335 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.816452 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.816465 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.816640 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.816690 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:34:57.816876 9945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.813144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:35669 (local address 127.7.252.2:42641)
0807 00:34:57.813333 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.813346 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.813412 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.813631 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.813632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.813637 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:57.813728 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.813730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.814569 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.814571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.815792 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.815796 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.816456 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.816457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.816554 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.816557 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.816632 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.816683 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":78,"thread_start_us":66,"threads_started":1}
I20260807 00:34:57.816999 9825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "558047bb18fb43529921a0df5fc9fd93" candidate_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aad866f94c4c41f2abd61724d6360883" is_pre_election: true
I20260807 00:34:57.817121 9825 raft_consensus.cc:2454] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb21a5c1c564fcd88d8f5f1a54c963a in term 0.
I20260807 00:34:57.817126 9521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "558047bb18fb43529921a0df5fc9fd93" candidate_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28b20609fdf44798911c7ce335ce17c" is_pre_election: true
I20260807 00:34:57.817229 9521 raft_consensus.cc:2454] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb21a5c1c564fcd88d8f5f1a54c963a in term 0.
I20260807 00:34:57.817368 9604 leader_election.cc:302] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aad866f94c4c41f2abd61724d6360883, ebb21a5c1c564fcd88d8f5f1a54c963a; no voters:
I20260807 00:34:57.817543 9909 raft_consensus.cc:2781] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:34:57.817615 9909 raft_consensus.cc:482] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:34:57.817641 9909 raft_consensus.cc:3037] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.818359 9909 raft_consensus.cc:504] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.818496 9909 leader_election.cc:288] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [CANDIDATE]: Term 1 election: Requested vote from peers e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669), aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479)
I20260807 00:34:57.818709 9521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "558047bb18fb43529921a0df5fc9fd93" candidate_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28b20609fdf44798911c7ce335ce17c"
I20260807 00:34:57.818792 9521 raft_consensus.cc:3037] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.818763 9825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "558047bb18fb43529921a0df5fc9fd93" candidate_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aad866f94c4c41f2abd61724d6360883"
I20260807 00:34:57.818913 9825 raft_consensus.cc:3037] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:57.819392 9521 raft_consensus.cc:2454] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb21a5c1c564fcd88d8f5f1a54c963a in term 1.
I20260807 00:34:57.819572 9604 leader_election.cc:302] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e28b20609fdf44798911c7ce335ce17c, ebb21a5c1c564fcd88d8f5f1a54c963a; no voters:
I20260807 00:34:57.819696 9909 raft_consensus.cc:2781] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:57.819821 9909 raft_consensus.cc:686] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 LEADER]: Becoming Leader. State: Replica: ebb21a5c1c564fcd88d8f5f1a54c963a, State: Running, Role: LEADER
I20260807 00:34:57.819799 9825 raft_consensus.cc:2454] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb21a5c1c564fcd88d8f5f1a54c963a in term 1.
I20260807 00:34:57.819897 9909 consensus_queue.cc:237] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } }
I20260807 00:34:57.820197 9947 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: TxnStatusTablet state changed. Reason: New leader ebb21a5c1c564fcd88d8f5f1a54c963a. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.820308 9947 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:34:57.820511 9949 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 00:34:57.820643 9949 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 00:34:57.820585 9357 catalog_manager.cc:5495] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a reported cstate change: term changed from 0 to 1, leader changed from <none> to ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2). New cstate: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } health_report { overall_health: UNKNOWN } } }
I20260807 00:34:57.853922 9941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.850811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:41599 (local address 127.0.0.1:57586)
0807 00:34:57.850908 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.850923 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.850996 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.851239 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.851240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.851242 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:34:57.851305 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.851308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.851957 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.851958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.852919 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.852922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.853297 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.853298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.853365 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.853386 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.853701 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.853711 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.853773 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.853830 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 00:34:57.853885 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.850874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.7.252.2:41599)
0807 00:34:57.850922 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.850924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.850985 (+ 61us) server_negotiation.cc:407] Connection header received
0807 00:34:57.851120 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.851121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.851140 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.851208 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:34:57.851396 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.851874 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.853019 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.853206 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.853273 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.853517 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.853622 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.853697 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.853775 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.853796 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:34:57.855376 9825 raft_consensus.cc:1261] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Refusing update from remote peer ebb21a5c1c564fcd88d8f5f1a54c963a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:34:57.855501 9521 raft_consensus.cc:1261] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Refusing update from remote peer ebb21a5c1c564fcd88d8f5f1a54c963a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:34:57.855664 9909 consensus_queue.cc:1035] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [LEADER]: Connected to new peer: Peer: permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:34:57.855777 9947 consensus_queue.cc:1035] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:34:57.856508 9912 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: TxnStatusTablet state changed. Reason: New leader ebb21a5c1c564fcd88d8f5f1a54c963a. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.856624 9912 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:34:57.856853 9910 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: TxnStatusTablet state changed. Reason: New leader ebb21a5c1c564fcd88d8f5f1a54c963a. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.856946 9910 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:34:57.857340 9909 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.857434 9909 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:34:57.857529 9909 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.857585 9909 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P ebb21a5c1c564fcd88d8f5f1a54c963a: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:34:57.857825 9912 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.857911 9912 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P e28b20609fdf44798911c7ce335ce17c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:34:57.858290 9910 tablet_replica.cc:439] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 } } peers { permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 } } peers { permanent_uuid: "aad866f94c4c41f2abd61724d6360883" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 46479 } } }
I20260807 00:34:57.858373 9910 tablet_replica.cc:442] T 558047bb18fb43529921a0df5fc9fd93 P aad866f94c4c41f2abd61724d6360883: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:34:57.862182 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.859743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60296 (local address 127.7.252.3:46479)
0807 00:34:57.859790 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.859792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.859802 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:57.859859 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.859860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.859880 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.859974 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:34:57.860088 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.860573 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.861318 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.861599 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.861686 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.861824 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.861938 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.862021 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.862061 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.862079 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:34:57.868759 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.865498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:43003 (local address 127.7.252.2:41599)
0807 00:34:57.865597 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.865600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.866159 (+ 559us) server_negotiation.cc:407] Connection header received
0807 00:34:57.866232 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.866233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.866260 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.866331 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:34:57.866492 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.867081 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.867935 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.868144 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.868281 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.868485 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.868523 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.868581 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.868655 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.868675 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 00:34:57.868818 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.865250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:41599 (local address 127.7.252.3:43003)
0807 00:34:57.866059 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.866071 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.866167 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.866333 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.866334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.866336 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:34:57.866405 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.866407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.867172 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.867173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.867832 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.867834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.868280 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.868281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.868355 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.868382 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.868598 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.868600 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.868650 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.868698 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":98,"threads_started":1}
I20260807 00:34:57.871848 9521 raft_consensus.cc:1261] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Refusing update from remote peer aad866f94c4c41f2abd61724d6360883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:34:57.871848 9674 raft_consensus.cc:1261] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Refusing update from remote peer aad866f94c4c41f2abd61724d6360883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:34:57.872372 9934 consensus_queue.cc:1035] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebb21a5c1c564fcd88d8f5f1a54c963a" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 41599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:34:57.872500 9910 consensus_queue.cc:1035] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28b20609fdf44798911c7ce335ce17c" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:34:57.881727 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.878887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:48419 (local address 127.7.252.3:46479)
0807 00:34:57.878931 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.878933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.879031 (+ 98us) server_negotiation.cc:407] Connection header received
0807 00:34:57.879095 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.879096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.879113 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.879159 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:34:57.879319 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.879785 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.880904 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.881208 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.881252 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.881491 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.881523 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.881568 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.881640 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.881661 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:34:57.882014 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.878778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:46479 (local address 127.7.252.2:48419)
0807 00:34:57.878970 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:57.878981 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:57.879046 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:57.879164 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:57.879165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:57.879166 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:34:57.879262 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.879263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.879862 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.879863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.880781 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:57.880783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.881312 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.881313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:57.881382 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.881402 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:34:57.881585 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:34:57.881586 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 00:34:57.881638 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 00:34:57.881688 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":83,"threads_started":1}
I20260807 00:34:57.892381 9355 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:34:57.892531 9355 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:34:57.893252 9355 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a75870fb30a44e059dca36419d8f36b4: Sending DeleteTablet for 3 replicas of tablet 954255937f7b43c5a606211f64d0f792
I20260807 00:34:57.893601 9651 tablet_service.cc:1514] Processing DeleteTablet for tablet 954255937f7b43c5a606211f64d0f792 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:34:57 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:47472
I20260807 00:34:57.893747 9500 tablet_service.cc:1514] Processing DeleteTablet for tablet 954255937f7b43c5a606211f64d0f792 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:34:57 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36568
I20260807 00:34:57.893879 9928 tablet_replica.cc:330] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: stopping tablet replica
I20260807 00:34:57.893903 9929 tablet_replica.cc:330] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: stopping tablet replica
I20260807 00:34:57.893939 9928 raft_consensus.cc:2229] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:34:57.893980 9928 raft_consensus.cc:2258] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:34:57.893980 9929 raft_consensus.cc:2229] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:34:57.894027 9929 raft_consensus.cc:2258] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:34:57.894057 9806 tablet_service.cc:1514] Processing DeleteTablet for tablet 954255937f7b43c5a606211f64d0f792 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:34:57 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:38502
I20260807 00:34:57.894228 9927 tablet_replica.cc:330] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: stopping tablet replica
I20260807 00:34:57.894279 9927 raft_consensus.cc:2229] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:34:57.894361 9927 raft_consensus.cc:2258] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:34:57.894447 9928 ts_tablet_manager.cc:1905] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:34:57.894850 9927 ts_tablet_manager.cc:1905] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:34:57.896504 9928 ts_tablet_manager.cc:1918] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:34:57.896572 9928 log.cc:1196] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/954255937f7b43c5a606211f64d0f792
I20260807 00:34:57.896667 9927 ts_tablet_manager.cc:1918] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:34:57.896724 9927 log.cc:1196] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/954255937f7b43c5a606211f64d0f792
I20260807 00:34:57.896843 9928 ts_tablet_manager.cc:1939] T 954255937f7b43c5a606211f64d0f792 P ebb21a5c1c564fcd88d8f5f1a54c963a: Deleting consensus metadata
I20260807 00:34:57.896947 9927 ts_tablet_manager.cc:1939] T 954255937f7b43c5a606211f64d0f792 P aad866f94c4c41f2abd61724d6360883: Deleting consensus metadata
I20260807 00:34:57.897328 9340 catalog_manager.cc:4841] TS ebb21a5c1c564fcd88d8f5f1a54c963a (127.7.252.2:41599): tablet 954255937f7b43c5a606211f64d0f792 (table test-table [id=49b0b5ec462e4ff3aab8c978d275c52d]) successfully deleted
I20260807 00:34:57.897684 9929 ts_tablet_manager.cc:1905] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:34:57.899502 9929 ts_tablet_manager.cc:1918] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:34:57.899576 9929 log.cc:1196] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/954255937f7b43c5a606211f64d0f792
I20260807 00:34:57.899796 9929 ts_tablet_manager.cc:1939] T 954255937f7b43c5a606211f64d0f792 P e28b20609fdf44798911c7ce335ce17c: Deleting consensus metadata
I20260807 00:34:57.899772 9344 catalog_manager.cc:4841] TS aad866f94c4c41f2abd61724d6360883 (127.7.252.3:46479): tablet 954255937f7b43c5a606211f64d0f792 (table test-table [id=49b0b5ec462e4ff3aab8c978d275c52d]) successfully deleted
I20260807 00:34:57.900434 9344 catalog_manager.cc:4841] TS e28b20609fdf44798911c7ce335ce17c (127.7.252.1:35669): tablet 954255937f7b43c5a606211f64d0f792 (table test-table [id=49b0b5ec462e4ff3aab8c978d275c52d]) successfully deleted
Aug 07 00:34:57 dist-test-slave-csg5 krb5kdc[9311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062897, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:34:57.912351 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.900315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60206 (local address 127.7.252.1:35669)
0807 00:34:57.900382 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.900385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.900838 (+ 453us) server_negotiation.cc:407] Connection header received
0807 00:34:57.900954 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.900956 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.900967 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.900999 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.901863 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.902929 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.904063 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.904398 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.904486 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.908551 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.908568 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.908568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.908578 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.910872 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.911346 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.911349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.911350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.911420 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.911674 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.911675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.911676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.911874 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.912019 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.912158 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.912249 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 00:34:57.912961 9564 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60206
I20260807 00:34:57.922879 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:57.914051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40446 (local address 127.7.252.62:42659)
0807 00:34:57.914103 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:57.914105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:57.914377 (+ 272us) server_negotiation.cc:407] Connection header received
0807 00:34:57.914444 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:57.914446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:57.914460 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:57.914533 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:57.915288 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.916205 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.917299 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:57.917665 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:57.917749 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:57.919411 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:57.919413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:57.919413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:57.919422 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:57.921421 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.921866 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.921867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.921868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.921939 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:57.922180 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:57.922181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:57.922182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:57.922341 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:57.922459 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:57.922609 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 00:34:57.922758 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260807 00:34:57.923270 9355 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40446
I20260807 00:34:57.924443 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 9431
I20260807 00:34:57.935941 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 9581
I20260807 00:34:57.943847 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 9733
I20260807 00:34:57.950487 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 9324
2026-08-07T00:34:57Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2687 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:34:58 dist-test-slave-csg5 krb5kdc[9973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:34:58 dist-test-slave-csg5 krb5kdc[9973](info): set up 2 sockets
Aug 07 00:34:58 dist-test-slave-csg5 krb5kdc[9973](info): commencing operation
krb5kdc: starting...
W20260807 00:34:59.090602 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:34:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:34:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:34:59.238324 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:34185
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:34185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:59.332459 9986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:59.332978 9986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:59.333012 9986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:59.334317 9986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:34:59.334376 9986 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 00:34:59.334391 9986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:59.334404 9986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:59.334417 9986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:34:59.334429 9986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:34:59.336135 9986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:34185
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:34185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:59.336421 9986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:59.336674 9986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:59.341894 9991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.341936 9992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.341904 9994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:59.342056 9986 server_base.cc:1034] running on GCE node
I20260807 00:34:59.342505 9986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:59.342887 9986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:59.344064 9986 hybrid_clock.cc:648] HybridClock initialized: now 1786062899344047 us; error 31 us; skew 500 ppm
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:59.346998 9986 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:34:59.347548 9986 webserver.cc:460] Webserver started at http://127.7.252.62:33559/ using document root <none> and password file <none>
I20260807 00:34:59.347819 9986 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:59.347904 9986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:59.348124 9986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:59.349373 9986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "2b62cee92244457b8f9f9cd68c07b462"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "2abfeb39ad9d486c3bb60425fe81fafb"
server_key_iv: "23df748131e1ef28c173e6b447efb58c"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.349805 9986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "2b62cee92244457b8f9f9cd68c07b462"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "2abfeb39ad9d486c3bb60425fe81fafb"
server_key_iv: "23df748131e1ef28c173e6b447efb58c"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.351449 9986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260807 00:34:59.352526 10001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.352823 9986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:59.352955 9986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "2b62cee92244457b8f9f9cd68c07b462"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "2abfeb39ad9d486c3bb60425fe81fafb"
server_key_iv: "23df748131e1ef28c173e6b447efb58c"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.353044 9986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:59.366546 9986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:59.369247 9986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:59.369459 9986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:59.375171 9986 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:34185
I20260807 00:34:59.375411 10067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:34185 every 8 connection(s)
I20260807 00:34:59.375707 9986 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:34:59.376453 10068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:34:59.379019 10068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Bootstrap starting.
I20260807 00:34:59.379670 10068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Neither blocks nor log segments found. Creating new log.
I20260807 00:34:59.379987 10068 log.cc:824] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Log is configured to *not* fsync() on all Append() calls
I20260807 00:34:59.380859 10068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: No bootstrap required, opened a new log
I20260807 00:34:59.383364 10068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b62cee92244457b8f9f9cd68c07b462" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34185 } }
I20260807 00:34:59.383525 10068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:34:59.383548 10068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b62cee92244457b8f9f9cd68c07b462, State: Initialized, Role: FOLLOWER
I20260807 00:34:59.383714 10068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b62cee92244457b8f9f9cd68c07b462" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34185 } }
I20260807 00:34:59.383801 10068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:34:59.383826 10068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:34:59.383877 10068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:34:59.384490 10068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b62cee92244457b8f9f9cd68c07b462" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34185 } }
I20260807 00:34:59.384621 10068 leader_election.cc:302] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b62cee92244457b8f9f9cd68c07b462; no voters:
I20260807 00:34:59.384859 10068 leader_election.cc:288] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:34:59.384990 10071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:34:59.385133 10068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:34:59.385200 10071 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [term 1 LEADER]: Becoming Leader. State: Replica: 2b62cee92244457b8f9f9cd68c07b462, State: Running, Role: LEADER
I20260807 00:34:59.385309 10071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b62cee92244457b8f9f9cd68c07b462" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34185 } }
I20260807 00:34:59.385768 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 9986
I20260807 00:34:59.385885 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:34:59.386075 8176 external_mini_cluster.cc:1428] Setting key 0095c11387b76246119c2e0fd4abd0d1
I20260807 00:34:59.386338 10072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b62cee92244457b8f9f9cd68c07b462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b62cee92244457b8f9f9cd68c07b462" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34185 } } }
I20260807 00:34:59.386435 10072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:59.386525 10073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b62cee92244457b8f9f9cd68c07b462. Latest consensus state: current_term: 1 leader_uuid: "2b62cee92244457b8f9f9cd68c07b462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b62cee92244457b8f9f9cd68c07b462" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34185 } } }
I20260807 00:34:59.386581 10073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462 [sys.catalog]: This master's current role is: LEADER
I20260807 00:34:59.386870 10087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:34:59.387408 10087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:34:59.389173 10087 catalog_manager.cc:1347] Generated new cluster ID: 970ee95b0d5c4f28b737e1f83fef6b54
I20260807 00:34:59.389233 10087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:59.394304 10087 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:34:59.395067 10087 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:34:59.398900 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.386814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33454 (local address 127.7.252.62:34185)
0807 00:34:59.387043 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.387051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.387076 (+ 25us) server_negotiation.cc:407] Connection header received
0807 00:34:59.387180 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.387193 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.387285 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.387433 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.388297 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.389716 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.390869 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.391531 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.391654 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.394628 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.394633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.394633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.394647 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.397017 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.397517 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.397520 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.397521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.397633 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.397881 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.397882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.397882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.398178 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.398346 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.398482 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.398637 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":68,"threads_started":1}
I20260807 00:34:59.401093 10087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Generated new TSK 0
I20260807 00:34:59.401292 10087 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:34:59.435169 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:34185
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:59.528949 10096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:59.529225 10096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:59.529270 10096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:59.530534 10096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:59.530614 10096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:59.530650 10096 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 00:34:59.530671 10096 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:34:59.530761 10096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:34:59.532349 10096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:34185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:59.532657 10096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:59.532917 10096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:59.538601 10104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.538755 10102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.538808 10101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:59.539654 10096 server_base.cc:1034] running on GCE node
I20260807 00:34:59.539923 10096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:59.540211 10096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:59.541438 10096 hybrid_clock.cc:648] HybridClock initialized: now 1786062899541422 us; error 30 us; skew 500 ppm
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:59.544612 10096 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:34:59.545208 10096 webserver.cc:460] Webserver started at http://127.7.252.1:46015/ using document root <none> and password file <none>
I20260807 00:34:59.545486 10096 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:59.545567 10096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:59.545739 10096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:59.547127 10096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "44e1d7f6f09940cc9f87dd076accc9d8"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "d4d4e824c4dca0b2dfb950361c6a95e6"
server_key_iv: "2ca6c1c02a2412aad6c445b6896774d7"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.547545 10096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "44e1d7f6f09940cc9f87dd076accc9d8"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "d4d4e824c4dca0b2dfb950361c6a95e6"
server_key_iv: "2ca6c1c02a2412aad6c445b6896774d7"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.549135 10096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:34:59.550006 10111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.550282 10096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:34:59.550418 10096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "44e1d7f6f09940cc9f87dd076accc9d8"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "d4d4e824c4dca0b2dfb950361c6a95e6"
server_key_iv: "2ca6c1c02a2412aad6c445b6896774d7"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.550509 10096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:59.580363 10096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:59.583211 10096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:59.583576 10096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:59.584226 10096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:59.584306 10096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.584348 10096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:59.584375 10096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:59.592350 10096 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42063
I20260807 00:34:59.592438 10235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42063 every 8 connection(s)
I20260807 00:34:59.592772 10096 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:34:59.595791 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.584783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:49369 (local address 127.7.252.62:34185)
0807 00:34:59.584864 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.584866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.585096 (+ 230us) server_negotiation.cc:407] Connection header received
0807 00:34:59.585729 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.585731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.585745 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.585833 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.586916 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.587806 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.589003 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.589380 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.589477 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.592574 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.592576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.592576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.592585 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.594132 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.594719 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.594721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.594721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.594823 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.595073 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.595074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.595074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.595202 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.595268 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.595623 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.595710 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 00:34:59.595924 10120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.584715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.7.252.1:49369)
0807 00:34:59.584977 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.585008 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.585610 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.585966 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.585970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.586471 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:59.586795 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.586802 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.587921 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.587922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.588929 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.588932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.589491 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.589492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.589649 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.590241 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:59.590251 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:59.592459 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:59.594218 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.594225 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.594227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.594565 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.594895 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.594896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.594896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.595002 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.595299 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:59.595306 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:59.595448 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 00:34:59.595549 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 00:34:59.595690 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":90,"threads_started":1}
I20260807 00:34:59.596599 10236 heartbeater.cc:347] Connected to a master server at 127.7.252.62:34185
I20260807 00:34:59.596689 10236 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:59.596899 10236 heartbeater.cc:511] Master 127.7.252.62:34185 requested a full tablet report, sending...
I20260807 00:34:59.597488 10018 ts_manager.cc:194] Registered new tserver with Master: 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063)
I20260807 00:34:59.598384 10018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:49369
I20260807 00:34:59.602463 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 10096
I20260807 00:34:59.602589 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:34:59.602828 8176 external_mini_cluster.cc:1428] Setting key fefec20eeef68a98f5937a1c3640bfcc
I20260807 00:34:59.603459 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.597716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:39057 (local address 127.7.252.62:34185)
0807 00:34:59.597754 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.597756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.597909 (+ 153us) server_negotiation.cc:407] Connection header received
0807 00:34:59.597936 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.597937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.597948 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.598012 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.598304 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.599045 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.599765 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.599942 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.599998 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.600880 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.600881 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.600881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.600887 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.602196 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.602550 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.602552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.602553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.602618 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.602877 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.602878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.602878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.603015 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.603090 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.603280 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.603367 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 00:34:59.603472 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.597671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.7.252.1:39057)
0807 00:34:59.597834 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.597843 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.597897 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.598016 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.598016 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.598180 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:59.598242 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.598244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.599154 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.599155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.599678 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.599681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.600009 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.600010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.600063 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.600452 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:59.600456 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:59.600793 (+ 337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:59.602294 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.602295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.602295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.602469 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.602737 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.602738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.602738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.602807 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.603100 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:59.603101 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:59.603175 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 00:34:59.603248 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 00:34:59.603364 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:34:59.634986 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:34185
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:59.719592 10245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:59.719812 10245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:59.719841 10245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:59.721042 10245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:59.721091 10245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:59.721113 10245 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 00:34:59.721124 10245 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:34:59.721143 10245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:34:59.722738 10245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:34185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:59.723016 10245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:59.723279 10245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:59.729233 10251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.729197 10250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.729219 10253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:59.729252 10245 server_base.cc:1034] running on GCE node
I20260807 00:34:59.729677 10245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:59.729966 10245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:59.731154 10245 hybrid_clock.cc:648] HybridClock initialized: now 1786062899731125 us; error 49 us; skew 500 ppm
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:59.734217 10245 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:34:59.734784 10245 webserver.cc:460] Webserver started at http://127.7.252.2:36991/ using document root <none> and password file <none>
I20260807 00:34:59.735018 10245 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:59.735065 10245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:59.735167 10245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:59.736369 10245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "cf295b088d734d2d92e2e6b2298a1914"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "eda07e37954a808c243f09c603b0180a"
server_key_iv: "3b59a16748b1d95f0bd5140a211ea3c9"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.736709 10245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "cf295b088d734d2d92e2e6b2298a1914"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "eda07e37954a808c243f09c603b0180a"
server_key_iv: "3b59a16748b1d95f0bd5140a211ea3c9"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.738237 10245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:34:59.739287 10260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.739588 10245 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:34:59.739675 10245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "cf295b088d734d2d92e2e6b2298a1914"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "eda07e37954a808c243f09c603b0180a"
server_key_iv: "3b59a16748b1d95f0bd5140a211ea3c9"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.739773 10245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:59.767917 10245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:59.770800 10245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:59.771106 10245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:59.771777 10245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:59.771853 10245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.771905 10245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:59.771951 10245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:59.780050 10245 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:45081
I20260807 00:34:59.780136 10380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:45081 every 8 connection(s)
I20260807 00:34:59.780470 10245 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:34:59.781622 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 10245
I20260807 00:34:59.781719 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:34:59.781934 8176 external_mini_cluster.cc:1428] Setting key c78a541dbf60aaa60e1523ec299a3220
I20260807 00:34:59.783569 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.772435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:44767 (local address 127.7.252.62:34185)
0807 00:34:59.772528 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.772531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.772781 (+ 250us) server_negotiation.cc:407] Connection header received
0807 00:34:59.773798 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.773800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.773814 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.773916 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.775002 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.775539 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.776605 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.776814 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.776901 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.780031 (+ 3130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.780032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.780033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.780041 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.781759 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.782288 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.782290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.782290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.782366 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.782777 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.782778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.782779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.782956 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.783038 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.783320 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.783422 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:34:59.783595 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.772410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.7.252.2:44767)
0807 00:34:59.772614 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.772673 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.773517 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.774018 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.774024 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.774500 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:59.774891 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.774900 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.775643 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.775644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.776497 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.776500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.776924 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.776925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.777072 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.777663 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:59.777671 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:59.779928 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:59.781864 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.781871 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.781873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.782190 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.782437 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.782437 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.782438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.782573 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.783039 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:59.783045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:59.783177 (+ 132us) client_negotiation.cc:769] Sending connection context
0807 00:34:59.783275 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 00:34:59.783422 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
I20260807 00:34:59.784320 10381 heartbeater.cc:347] Connected to a master server at 127.7.252.62:34185
I20260807 00:34:59.784423 10381 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:59.784693 10381 heartbeater.cc:511] Master 127.7.252.62:34185 requested a full tablet report, sending...
I20260807 00:34:59.785189 10017 ts_manager.cc:194] Registered new tserver with Master: cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081)
I20260807 00:34:59.785859 10017 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:44767
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:34:59.793666 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.785478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:33941 (local address 127.7.252.62:34185)
0807 00:34:59.785521 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.785524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.785692 (+ 168us) server_negotiation.cc:407] Connection header received
0807 00:34:59.785789 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.785800 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.785812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.785867 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.786333 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.787125 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.788183 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.788520 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.788604 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.790617 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.790619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.790619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.790627 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.792311 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.792719 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.792720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.792720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.792784 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.793025 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.793026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.793026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.793228 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.793316 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.793521 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.793594 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:34:59.793675 10388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.785417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.7.252.2:33941)
0807 00:34:59.785623 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.785635 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.785718 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.785888 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.785889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.786111 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:59.786217 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.786219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.787220 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.787221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.788093 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.788095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.788615 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.788617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.788761 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.790154 (+ 1393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:59.790160 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:59.790509 (+ 349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:59.792435 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.792436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.792436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.792634 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.792876 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.792877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.792877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.792946 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.793381 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:59.793382 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:59.793428 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 00:34:59.793504 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 00:34:59.793596 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":152,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:34:59.813695 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:34185
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:45147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:34:59.900826 10390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:34:59.901072 10390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:34:59.901101 10390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:34:59.902496 10390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:34:59.902549 10390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:34:59.902571 10390 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 00:34:59.902585 10390 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:34:59.902602 10390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:34:59.904232 10390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:45147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:34185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:34:59.904511 10390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:34:59.904773 10390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:34:59.910545 10398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:34:59.910499 10397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:59.910626 10390 server_base.cc:1034] running on GCE node
W20260807 00:34:59.910506 10400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:34:59.911124 10390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:34:59.911365 10390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:34:59.912523 10390 hybrid_clock.cc:648] HybridClock initialized: now 1786062899912490 us; error 54 us; skew 500 ppm
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:34:59.915450 10390 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:34:59.915988 10390 webserver.cc:460] Webserver started at http://127.7.252.3:42499/ using document root <none> and password file <none>
I20260807 00:34:59.916232 10390 fs_manager.cc:359] Metadata directory not provided
I20260807 00:34:59.916312 10390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:34:59.916466 10390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:34:59.917578 10390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "d36a4584bd0147deb7d816c81f93d40d"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "a614ca26dde28c0e357cd84870dbfa64"
server_key_iv: "5445f7683d32e047ceb64ebe27c78d93"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.917966 10390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "d36a4584bd0147deb7d816c81f93d40d"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "a614ca26dde28c0e357cd84870dbfa64"
server_key_iv: "5445f7683d32e047ceb64ebe27c78d93"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.919517 10390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:34:59.920439 10407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.920616 10390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:34:59.920718 10390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "d36a4584bd0147deb7d816c81f93d40d"
format_stamp: "Formatted at 2026-08-07 00:34:59 on dist-test-slave-csg5"
server_key: "a614ca26dde28c0e357cd84870dbfa64"
server_key_iv: "5445f7683d32e047ceb64ebe27c78d93"
server_key_version: "encryptionkey@0"
I20260807 00:34:59.920811 10390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:34:59.935446 10390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:34:59.938105 10390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:34:59.938339 10390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:34:59.939096 10390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:34:59.939154 10390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:34:59.939188 10390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:34:59.939209 10390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:59.946823 10390 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:37309
I20260807 00:34:59.947229 10390 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:34:59.947230 10533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:37309 every 8 connection(s)
I20260807 00:34:59.949771 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.939635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:58723 (local address 127.7.252.62:34185)
0807 00:34:59.939713 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.939716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.939978 (+ 262us) server_negotiation.cc:407] Connection header received
0807 00:34:59.940479 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.940480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.940496 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.940580 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.941660 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.942518 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.943703 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.943930 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.944012 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.946498 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.946500 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.946500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.946509 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.948143 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.948764 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.948765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.948765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.948847 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.949099 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.949099 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.949100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.949228 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.949287 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.949572 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.949650 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 00:34:59.949910 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.939639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.7.252.3:58723)
0807 00:34:59.939839 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.939881 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.940381 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.940671 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.940674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.941079 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:59.941540 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.941549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.942627 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.942628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.943607 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.943610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.944035 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.944036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.944170 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.944781 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:59.944792 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:59.946389 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:59.948363 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.948369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.948371 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.948619 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.948926 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.948926 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.948927 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.949031 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.949326 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:59.949331 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:59.949451 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 00:34:59.949536 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 00:34:59.949665 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":126,"threads_started":1}
I20260807 00:34:59.950002 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 10390
I20260807 00:34:59.950083 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:34:59.950276 8176 external_mini_cluster.cc:1428] Setting key 8c3ee00cf7c8a6241f56f2625af1d04e
I20260807 00:34:59.950383 10534 heartbeater.cc:347] Connected to a master server at 127.7.252.62:34185
I20260807 00:34:59.950479 10534 heartbeater.cc:464] Registering TS with master...
I20260807 00:34:59.950766 10534 heartbeater.cc:511] Master 127.7.252.62:34185 requested a full tablet report, sending...
I20260807 00:34:59.951355 10018 ts_manager.cc:194] Registered new tserver with Master: d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:34:59.951828 10018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:58723
I20260807 00:34:59.958822 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.951541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.7.252.3:41991)
0807 00:34:59.951993 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.952004 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.952058 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.952326 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.952327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.952534 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:34:59.952602 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.952604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.953528 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.953529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.954113 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.954115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.954464 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.954465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:34:59.954523 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.955035 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:34:59.955039 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:34:59.955432 (+ 393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:34:59.957489 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.957490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.957490 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.957676 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.957925 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:34:59.957926 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:34:59.957926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:34:59.957994 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:34:59.958419 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:34:59.958420 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:34:59.958474 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 00:34:59.958541 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 00:34:59.958638 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":76,"threads_started":1}
I20260807 00:34:59.958916 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.951593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:41991 (local address 127.7.252.62:34185)
0807 00:34:59.951635 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.951637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.952073 (+ 436us) server_negotiation.cc:407] Connection header received
0807 00:34:59.952102 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.952103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.952115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.952320 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.952691 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.953398 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.954204 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.954392 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.954458 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.955543 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.955545 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.955545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.955551 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.957389 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.957766 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.957767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.957767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.957827 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.958087 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.958088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.958089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.958309 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.958398 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.958620 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.958781 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:34:59.962415 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 00:34:59 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:34:59.990374 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.981874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.7.252.62:34185)
0807 00:34:59.981951 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.981954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.981964 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:59.982002 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.982003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.982012 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.982082 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:34:59.982845 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.983382 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.984139 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.984386 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.984467 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:34:59.987394 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:34:59.987395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:34:59.987396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:34:59.987405 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:34:59.988752 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.989359 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.989361 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.989361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.989429 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:34:59.989640 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:34:59.989641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:34:59.989642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:34:59.989832 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:34:59.989914 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:34:59.990172 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 00:34:59.990271 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:34:59.992555 10018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:34:59.994267 10018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:00.002269 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.996982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:45081 (local address 127.0.0.1:34710)
0807 00:34:59.997264 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.997314 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.997392 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.997765 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.997768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.997771 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:59.997887 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.997889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.999141 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.999142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.000711 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.000714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.001939 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.002023 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.002028 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.002081 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.002166 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":5,"thread_start_us":78,"threads_started":1}
I20260807 00:35:00.002317 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.997185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42940 (local address 127.7.252.1:42063)
0807 00:34:59.997615 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.997619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.997629 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:34:59.997670 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.997673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.997688 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.997771 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:59.998003 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.999220 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001070 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.001830 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001908 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.001970 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.002149 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.002192 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":130,"threads_started":1}
I20260807 00:35:00.002370 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.997412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36994 (local address 127.7.252.3:37309)
0807 00:34:59.997605 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.997610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.997682 (+ 72us) server_negotiation.cc:407] Connection header received
0807 00:34:59.998080 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.998084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.998101 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.998178 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:59.998291 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.999365 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.000969 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.001768 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001892 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.001965 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.002130 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.002171 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":111,"threads_started":1}
I20260807 00:35:00.002592 10555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.997050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42063 (local address 127.0.0.1:42940)
0807 00:34:59.997406 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.997416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.997461 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.997772 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.997774 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.997776 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:59.997906 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.997909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.999334 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.999335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.000882 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.000885 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.001998 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.002054 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.002057 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.002105 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.002474 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":338,"thread_start_us":116,"threads_started":1}
I20260807 00:35:00.002593 10552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.997207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37309 (local address 127.0.0.1:36994)
0807 00:34:59.997624 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 00:34:59.997634 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:34:59.997965 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:34:59.998179 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:34:59.998180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:34:59.998182 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:34:59.998225 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:34:59.998227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.999448 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:34:59.999449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.000853 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.000856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.001897 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.001990 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.002006 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.002110 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.002162 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260807 00:35:00.003533 10554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:34:59.997116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34710 (local address 127.7.252.2:45081)
0807 00:34:59.997560 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0807 00:34:59.997567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 00:34:59.997578 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:34:59.997624 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:34:59.997626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:34:59.997645 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:34:59.998009 (+ 364us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:34:59.998077 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:34:59.999047 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.001007 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.001837 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.003270 (+ 1433us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.003346 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.003375 (+ 29us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.003420 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":93,"threads_started":1}
I20260807 00:35:00.003569 10461 tablet_service.cc:1467] Processing CreateTablet for tablet 518be37bd52249c5b9afd4079df83558 (DEFAULT_TABLE table=test-table [id=334af639b6644030968877dd1596404c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:00.003571 10164 tablet_service.cc:1467] Processing CreateTablet for tablet 518be37bd52249c5b9afd4079df83558 (DEFAULT_TABLE table=test-table [id=334af639b6644030968877dd1596404c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:00.003929 10461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518be37bd52249c5b9afd4079df83558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.004176 10164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518be37bd52249c5b9afd4079df83558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.004384 10312 tablet_service.cc:1467] Processing CreateTablet for tablet 518be37bd52249c5b9afd4079df83558 (DEFAULT_TABLE table=test-table [id=334af639b6644030968877dd1596404c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:00.004709 10312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518be37bd52249c5b9afd4079df83558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.007648 10560 tablet_bootstrap.cc:492] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Bootstrap starting.
I20260807 00:35:00.008361 10562 tablet_bootstrap.cc:492] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Bootstrap starting.
I20260807 00:35:00.008852 10561 tablet_bootstrap.cc:492] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Bootstrap starting.
I20260807 00:35:00.009009 10560 tablet_bootstrap.cc:654] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.009027 10562 tablet_bootstrap.cc:654] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.009356 10560 log.cc:824] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:00.009380 10562 log.cc:824] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:00.009542 10561 tablet_bootstrap.cc:654] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.009913 10561 log.cc:824] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:00.010272 10560 tablet_bootstrap.cc:492] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: No bootstrap required, opened a new log
I20260807 00:35:00.010329 10560 ts_tablet_manager.cc:1397] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:35:00.010792 10561 tablet_bootstrap.cc:492] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: No bootstrap required, opened a new log
I20260807 00:35:00.010869 10561 ts_tablet_manager.cc:1397] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:35:00.011135 10562 tablet_bootstrap.cc:492] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: No bootstrap required, opened a new log
I20260807 00:35:00.011233 10562 ts_tablet_manager.cc:1397] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 00:35:00.012590 10560 raft_consensus.cc:348] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.012786 10560 raft_consensus.cc:374] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.012862 10560 raft_consensus.cc:729] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.013010 10560 consensus_queue.cc:260] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.013053 10561 raft_consensus.cc:348] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.013222 10561 raft_consensus.cc:374] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.013260 10561 raft_consensus.cc:729] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.013319 10560 ts_tablet_manager.cc:1428] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:00.013310 10562 raft_consensus.cc:348] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.013465 10534 heartbeater.cc:503] Master 127.7.252.62:34185 was elected leader, sending a full tablet report...
I20260807 00:35:00.013489 10562 raft_consensus.cc:374] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.013458 10561 consensus_queue.cc:260] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.013528 10562 raft_consensus.cc:729] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf295b088d734d2d92e2e6b2298a1914, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.013649 10562 consensus_queue.cc:260] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.013736 10561 ts_tablet_manager.cc:1428] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:00.013860 10236 heartbeater.cc:503] Master 127.7.252.62:34185 was elected leader, sending a full tablet report...
I20260807 00:35:00.013934 10562 ts_tablet_manager.cc:1428] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:00.014089 10381 heartbeater.cc:503] Master 127.7.252.62:34185 was elected leader, sending a full tablet report...
W20260807 00:35:00.031410 10382 tablet.cc:2369] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:00.050715 10566 raft_consensus.cc:482] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:00.050848 10566 raft_consensus.cc:504] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.051254 10566 leader_election.cc:288] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063)
I20260807 00:35:00.054693 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.051540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42063 (local address 127.7.252.3:54381)
0807 00:35:00.051614 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.051627 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.051680 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.051872 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.051874 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.051875 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:00.051957 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.051959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.052652 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.052654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.053612 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.053614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.054370 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.054371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.054467 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.054471 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.054543 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.054587 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 00:35:00.054697 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.051614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:54381 (local address 127.7.252.1:42063)
0807 00:35:00.051669 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.051672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.051736 (+ 64us) server_negotiation.cc:407] Connection header received
0807 00:35:00.051772 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.051773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.051789 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.051867 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:00.052045 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.052563 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.053721 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.054273 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.054359 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.054370 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.054549 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.054587 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 00:35:00.054844 10554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.051599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:58393 (local address 127.7.252.2:45081)
0807 00:35:00.051654 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.051657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.051897 (+ 240us) server_negotiation.cc:407] Connection header received
0807 00:35:00.051968 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.051969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.051982 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.052048 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:00.052239 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.052772 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.053866 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.054415 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.054500 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.054511 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.054728 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.054773 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 00:35:00.054869 10569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.051556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:45081 (local address 127.7.252.3:58393)
0807 00:35:00.051785 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.051793 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.051901 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.052051 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.052052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.052053 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:00.052141 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.052143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.052900 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.052901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.053767 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.053769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.054515 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.054516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.054609 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.054613 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.054718 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.054762 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":128,"threads_started":1}
I20260807 00:35:00.055089 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518be37bd52249c5b9afd4079df83558" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" is_pre_election: true
I20260807 00:35:00.055274 10181 raft_consensus.cc:2454] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 0.
I20260807 00:35:00.055241 10332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518be37bd52249c5b9afd4079df83558" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914" is_pre_election: true
I20260807 00:35:00.055375 10332 raft_consensus.cc:2454] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 0.
I20260807 00:35:00.055546 10411 leader_election.cc:302] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, d36a4584bd0147deb7d816c81f93d40d; no voters:
I20260807 00:35:00.055706 10566 raft_consensus.cc:2781] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:00.055773 10566 raft_consensus.cc:482] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:00.055809 10566 raft_consensus.cc:3037] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.056674 10566 raft_consensus.cc:504] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.056829 10566 leader_election.cc:288] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 election: Requested vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063)
I20260807 00:35:00.057003 10332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518be37bd52249c5b9afd4079df83558" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914"
I20260807 00:35:00.057137 10332 raft_consensus.cc:3037] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.057952 10332 raft_consensus.cc:2454] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 1.
I20260807 00:35:00.058089 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518be37bd52249c5b9afd4079df83558" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44e1d7f6f09940cc9f87dd076accc9d8"
I20260807 00:35:00.058182 10409 leader_election.cc:302] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf295b088d734d2d92e2e6b2298a1914, d36a4584bd0147deb7d816c81f93d40d; no voters:
I20260807 00:35:00.058182 10181 raft_consensus.cc:3037] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.058282 10566 raft_consensus.cc:2781] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:00.058454 10566 raft_consensus.cc:686] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 1 LEADER]: Becoming Leader. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Running, Role: LEADER
I20260807 00:35:00.058555 10566 consensus_queue.cc:237] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } }
I20260807 00:35:00.059262 10181 raft_consensus.cc:2454] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 1.
I20260807 00:35:00.059942 10018 catalog_manager.cc:5495] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d reported cstate change: term changed from 0 to 1, leader changed from <none> to d36a4584bd0147deb7d816c81f93d40d (127.7.252.3). New cstate: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } health_report { overall_health: UNKNOWN } } }
W20260807 00:35:00.093937 10237 tablet.cc:2369] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 00:35:00 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062899, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:00.107772 10578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.099424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:34185 (local address 127.0.0.1:33484)
0807 00:35:00.099729 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.099741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.099852 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.100027 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.100027 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.100439 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:00.100489 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.100493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.101182 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.101183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.101713 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.101714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.102073 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.102074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.102128 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.102754 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:00.102760 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:00.104623 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:00.106526 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:00.106535 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:00.106538 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:00.106885 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:00.107104 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:00.107104 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:00.107105 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:00.107168 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:00.107436 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:00.107443 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:00.107494 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.107558 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.107665 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":222,"threads_started":1}
I20260807 00:35:00.107874 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.099608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33484 (local address 127.7.252.62:34185)
0807 00:35:00.099719 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.099722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.099833 (+ 111us) server_negotiation.cc:407] Connection header received
0807 00:35:00.099935 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.099935 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.099947 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.100021 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:00.100597 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.101091 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.101802 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.101986 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.102074 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.104755 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:00.104756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:00.104756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:00.104764 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:00.106418 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:00.106966 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:00.106967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:00.106968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:00.107028 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:00.107228 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:00.107229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:00.107229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:00.107368 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:00.107426 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.107593 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.107722 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":74}
I20260807 00:35:00.110397 10018 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:33484:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 00:35:00.110641 10018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:00.112646 10312 tablet_service.cc:1467] Processing CreateTablet for tablet 59fc3c6549044f34bd9ef9ec7c3bdebe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f7386d01f16c4f418c26f6191fc4badc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:35:00.112603 10164 tablet_service.cc:1467] Processing CreateTablet for tablet 59fc3c6549044f34bd9ef9ec7c3bdebe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f7386d01f16c4f418c26f6191fc4badc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:35:00.112876 10312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59fc3c6549044f34bd9ef9ec7c3bdebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.112886 10164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59fc3c6549044f34bd9ef9ec7c3bdebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.112881 10461 tablet_service.cc:1467] Processing CreateTablet for tablet 59fc3c6549044f34bd9ef9ec7c3bdebe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f7386d01f16c4f418c26f6191fc4badc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:35:00.113027 10461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59fc3c6549044f34bd9ef9ec7c3bdebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.114557 10562 tablet_bootstrap.cc:492] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: Bootstrap starting.
I20260807 00:35:00.114626 10561 tablet_bootstrap.cc:492] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: Bootstrap starting.
I20260807 00:35:00.114780 10560 tablet_bootstrap.cc:492] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: Bootstrap starting.
I20260807 00:35:00.115111 10561 tablet_bootstrap.cc:654] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.115348 10560 tablet_bootstrap.cc:654] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.115371 10562 tablet_bootstrap.cc:654] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.115804 10561 tablet_bootstrap.cc:492] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: No bootstrap required, opened a new log
I20260807 00:35:00.115861 10561 ts_tablet_manager.cc:1397] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:00.116130 10560 tablet_bootstrap.cc:492] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: No bootstrap required, opened a new log
I20260807 00:35:00.116189 10560 ts_tablet_manager.cc:1397] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:00.116133 10561 raft_consensus.cc:348] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.116220 10561 raft_consensus.cc:374] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.116269 10561 raft_consensus.cc:729] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.116324 10561 consensus_queue.cc:260] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.116366 10560 raft_consensus.cc:348] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.116467 10560 raft_consensus.cc:374] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.116469 10561 ts_tablet_manager.cc:1428] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:00.116494 10560 raft_consensus.cc:729] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.116535 10560 consensus_queue.cc:260] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.116570 10567 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.116633 10560 ts_tablet_manager.cc:1428] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 00:35:00.116676 10567 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.116644 10570 raft_consensus.cc:482] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:00.116737 10570 raft_consensus.cc:504] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.116834 10566 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.116909 10570 leader_election.cc:288] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063), cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081)
I20260807 00:35:00.116914 10566 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.117476 10332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fc3c6549044f34bd9ef9ec7c3bdebe" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914" is_pre_election: true
I20260807 00:35:00.117782 10562 tablet_bootstrap.cc:492] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: No bootstrap required, opened a new log
I20260807 00:35:00.117842 10562 ts_tablet_manager.cc:1397] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 00:35:00.117836 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fc3c6549044f34bd9ef9ec7c3bdebe" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" is_pre_election: true
I20260807 00:35:00.117956 10181 raft_consensus.cc:2454] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 0.
I20260807 00:35:00.118023 10562 raft_consensus.cc:348] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.118111 10562 raft_consensus.cc:374] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.118139 10562 raft_consensus.cc:729] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf295b088d734d2d92e2e6b2298a1914, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.118194 10562 consensus_queue.cc:260] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.118304 10562 ts_tablet_manager.cc:1428] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260807 00:35:00.118199 10409 leader_election.cc:341] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081): Illegal state: must be running to vote when last-logged opid is not known
I20260807 00:35:00.118372 10409 leader_election.cc:302] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, d36a4584bd0147deb7d816c81f93d40d; no voters: cf295b088d734d2d92e2e6b2298a1914
I20260807 00:35:00.118484 10566 raft_consensus.cc:2781] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:00.118461 10568 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.118533 10566 raft_consensus.cc:482] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:00.118541 10568 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.118561 10566 raft_consensus.cc:3037] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.119432 10566 raft_consensus.cc:504] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.119580 10566 leader_election.cc:288] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 election: Requested vote from peers 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063), cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081)
I20260807 00:35:00.119743 10332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fc3c6549044f34bd9ef9ec7c3bdebe" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914"
I20260807 00:35:00.119818 10332 raft_consensus.cc:3037] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.119814 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fc3c6549044f34bd9ef9ec7c3bdebe" candidate_uuid: "d36a4584bd0147deb7d816c81f93d40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44e1d7f6f09940cc9f87dd076accc9d8"
I20260807 00:35:00.119923 10181 raft_consensus.cc:3037] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.120499 10332 raft_consensus.cc:2454] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 1.
I20260807 00:35:00.120545 10181 raft_consensus.cc:2454] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36a4584bd0147deb7d816c81f93d40d in term 1.
I20260807 00:35:00.120699 10409 leader_election.cc:302] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf295b088d734d2d92e2e6b2298a1914, d36a4584bd0147deb7d816c81f93d40d; no voters:
I20260807 00:35:00.120826 10566 raft_consensus.cc:2781] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:00.120910 10566 raft_consensus.cc:686] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [term 1 LEADER]: Becoming Leader. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Running, Role: LEADER
I20260807 00:35:00.120961 10566 consensus_queue.cc:237] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.121294 10566 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: TxnStatusTablet state changed. Reason: New leader d36a4584bd0147deb7d816c81f93d40d. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.121364 10566 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:35:00.121690 10017 catalog_manager.cc:5495] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d reported cstate change: term changed from 0 to 1, leader changed from <none> to d36a4584bd0147deb7d816c81f93d40d (127.7.252.3). New cstate: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } health_report { overall_health: HEALTHY } } }
I20260807 00:35:00.122063 10585 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 00:35:00.122221 10585 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 00:35:00.130980 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.127968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36998 (local address 127.7.252.3:37309)
0807 00:35:00.128024 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.128026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.128036 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:00.128142 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.128143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.128161 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.128230 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:00.128414 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.128923 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.130046 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.130255 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.130325 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.130556 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.130650 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.130823 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.130892 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.130915 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 00:35:00.131035 10578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.127878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37309 (local address 127.0.0.1:36998)
0807 00:35:00.127977 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.127991 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.128048 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.128237 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.128238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.128240 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:00.128311 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.128314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.129015 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.129016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.129954 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.129957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.130353 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.130354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.130433 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.130454 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.130814 (+ 360us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.130825 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.130889 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.130946 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 00:35:00.133306 10181 raft_consensus.cc:1261] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Refusing update from remote peer d36a4584bd0147deb7d816c81f93d40d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:00.133670 10570 consensus_queue.cc:1035] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:00.133978 10332 raft_consensus.cc:1261] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Refusing update from remote peer d36a4584bd0147deb7d816c81f93d40d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:00.134476 10570 consensus_queue.cc:1035] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:00.135011 10567 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: TxnStatusTablet state changed. Reason: New leader d36a4584bd0147deb7d816c81f93d40d. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.135107 10567 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.136158 10568 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: TxnStatusTablet state changed. Reason: New leader d36a4584bd0147deb7d816c81f93d40d. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.136289 10568 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.137460 10570 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.137575 10570 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:35:00.137686 10570 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.137738 10570 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P d36a4584bd0147deb7d816c81f93d40d: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:35:00.137678 10568 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.137761 10568 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P cf295b088d734d2d92e2e6b2298a1914: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.138124 10588 mvcc.cc:205] Tried to move back new op lower bound from 7315713638942240768 to 7315713638895943680. Current Snapshot: MvccSnapshot[applied={T|T < 7315713638942240768}]
I20260807 00:35:00.138263 10591 mvcc.cc:205] Tried to move back new op lower bound from 7315713638942240768 to 7315713638895943680. Current Snapshot: MvccSnapshot[applied={T|T < 7315713638942240768}]
I20260807 00:35:00.138759 10567 tablet_replica.cc:439] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d36a4584bd0147deb7d816c81f93d40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } } }
I20260807 00:35:00.138870 10567 tablet_replica.cc:442] T 59fc3c6549044f34bd9ef9ec7c3bdebe P 44e1d7f6f09940cc9f87dd076accc9d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:00.143356 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.140793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37008 (local address 127.7.252.3:37309)
0807 00:35:00.140864 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.140866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.140874 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:00.140895 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.140896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.140914 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.140975 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:00.141137 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.141631 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.142414 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.142705 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.142776 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.142971 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.143012 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.143068 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.143248 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.143273 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 00:35:00.149384 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.146920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37309 (local address 127.7.252.3:45849)
0807 00:35:00.146989 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.147002 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.147040 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.147180 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.147181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.147182 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:00.147255 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.147257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.147943 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.147944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.148533 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.148534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.148902 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.148903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.148961 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.148984 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.149193 (+ 209us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.149194 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.149248 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.149299 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":3}
I20260807 00:35:00.149384 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.146976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:45849 (local address 127.7.252.3:37309)
0807 00:35:00.147019 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.147021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.147040 (+ 19us) server_negotiation.cc:407] Connection header received
0807 00:35:00.147107 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.147108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.147116 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.147178 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:00.147409 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.147849 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.148634 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.148831 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.148905 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.149093 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.149126 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.149193 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.149252 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.149280 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":23}
I20260807 00:35:00.152616 10181 raft_consensus.cc:1261] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Refusing update from remote peer d36a4584bd0147deb7d816c81f93d40d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:00.152619 10332 raft_consensus.cc:1261] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Refusing update from remote peer d36a4584bd0147deb7d816c81f93d40d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:00.152964 10570 consensus_queue.cc:1035] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:00.153102 10566 consensus_queue.cc:1035] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:00.165350 10589 mvcc.cc:205] Tried to move back new op lower bound from 7315713639023099904 to 7315713638640685056. Current Snapshot: MvccSnapshot[applied={T|T < 7315713639023099904}]
I20260807 00:35:00.175865 10018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:00.176018 10018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:00.176890 10018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Sending DeleteTablet for 3 replicas of tablet 518be37bd52249c5b9afd4079df83558
I20260807 00:35:00.177309 10164 tablet_service.cc:1514] Processing DeleteTablet for tablet 518be37bd52249c5b9afd4079df83558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:00 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:42940
I20260807 00:35:00.177589 10605 tablet_replica.cc:330] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: stopping tablet replica
I20260807 00:35:00.177580 10312 tablet_service.cc:1514] Processing DeleteTablet for tablet 518be37bd52249c5b9afd4079df83558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:00 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:34710
I20260807 00:35:00.177733 10605 raft_consensus.cc:2229] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:00.177829 10605 raft_consensus.cc:2258] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:00.177806 10461 tablet_service.cc:1514] Processing DeleteTablet for tablet 518be37bd52249c5b9afd4079df83558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:00 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36994
I20260807 00:35:00.178045 10018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:00.178237 10018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:00.178555 10605 ts_tablet_manager.cc:1905] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:00.178660 10606 tablet_replica.cc:330] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: stopping tablet replica
I20260807 00:35:00.178819 10606 raft_consensus.cc:2229] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:00.178886 10606 raft_consensus.cc:2258] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:00.179064 10607 tablet_replica.cc:330] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: stopping tablet replica
I20260807 00:35:00.179191 10607 raft_consensus.cc:2229] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:00.179311 10607 raft_consensus.cc:2258] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:00.179905 10164 tablet_service.cc:1467] Processing CreateTablet for tablet acf4a7db8f7f43baa185f97444c7c804 (DEFAULT_TABLE table=test-table [id=440be841897045589e96d194ad180df5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:00.180109 10164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf4a7db8f7f43baa185f97444c7c804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.181211 10605 ts_tablet_manager.cc:1918] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:00.181303 10605 log.cc:1196] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/518be37bd52249c5b9afd4079df83558
I20260807 00:35:00.181404 10312 tablet_service.cc:1467] Processing CreateTablet for tablet acf4a7db8f7f43baa185f97444c7c804 (DEFAULT_TABLE table=test-table [id=440be841897045589e96d194ad180df5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:00.181531 10312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf4a7db8f7f43baa185f97444c7c804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.181613 10605 ts_tablet_manager.cc:1939] T 518be37bd52249c5b9afd4079df83558 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting consensus metadata
I20260807 00:35:00.182789 10561 tablet_bootstrap.cc:492] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Bootstrap starting.
I20260807 00:35:00.182938 10562 tablet_bootstrap.cc:492] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Bootstrap starting.
I20260807 00:35:00.183251 10561 tablet_bootstrap.cc:654] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.183370 10562 tablet_bootstrap.cc:654] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.183723 10461 tablet_service.cc:1467] Processing CreateTablet for tablet acf4a7db8f7f43baa185f97444c7c804 (DEFAULT_TABLE table=test-table [id=440be841897045589e96d194ad180df5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:00.183871 10461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf4a7db8f7f43baa185f97444c7c804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:00.184224 10562 tablet_bootstrap.cc:492] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: No bootstrap required, opened a new log
I20260807 00:35:00.184274 10562 ts_tablet_manager.cc:1397] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:00.184345 10561 tablet_bootstrap.cc:492] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: No bootstrap required, opened a new log
I20260807 00:35:00.184396 10561 ts_tablet_manager.cc:1397] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:00.184445 10562 raft_consensus.cc:348] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.184547 10562 raft_consensus.cc:374] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.184576 10562 raft_consensus.cc:729] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf295b088d734d2d92e2e6b2298a1914, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.184540 10561 raft_consensus.cc:348] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.184614 10561 raft_consensus.cc:374] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.184636 10561 raft_consensus.cc:729] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.184617 10562 consensus_queue.cc:260] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.184681 10561 consensus_queue.cc:260] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.184711 10562 ts_tablet_manager.cc:1428] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 00:35:00.184768 10561 ts_tablet_manager.cc:1428] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:00.185468 10560 tablet_bootstrap.cc:492] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Bootstrap starting.
I20260807 00:35:00.185710 10005 catalog_manager.cc:4841] TS 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063): tablet 518be37bd52249c5b9afd4079df83558 (table test-table [id=334af639b6644030968877dd1596404c]) successfully deleted
I20260807 00:35:00.185925 10560 tablet_bootstrap.cc:654] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:00.186208 10607 ts_tablet_manager.cc:1905] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:00.186635 10560 tablet_bootstrap.cc:492] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: No bootstrap required, opened a new log
I20260807 00:35:00.186713 10560 ts_tablet_manager.cc:1397] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:00.186846 10606 ts_tablet_manager.cc:1905] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:00.186853 10560 raft_consensus.cc:348] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.186919 10560 raft_consensus.cc:374] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:00.186941 10560 raft_consensus.cc:729] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Initialized, Role: FOLLOWER
I20260807 00:35:00.186987 10560 consensus_queue.cc:260] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.187067 10560 ts_tablet_manager.cc:1428] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:00.188084 10607 ts_tablet_manager.cc:1918] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:00.188160 10607 log.cc:1196] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/518be37bd52249c5b9afd4079df83558
I20260807 00:35:00.188431 10607 ts_tablet_manager.cc:1939] T 518be37bd52249c5b9afd4079df83558 P d36a4584bd0147deb7d816c81f93d40d: Deleting consensus metadata
I20260807 00:35:00.188586 10606 ts_tablet_manager.cc:1918] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:00.188663 10606 log.cc:1196] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/518be37bd52249c5b9afd4079df83558
I20260807 00:35:00.188941 10606 ts_tablet_manager.cc:1939] T 518be37bd52249c5b9afd4079df83558 P cf295b088d734d2d92e2e6b2298a1914: Deleting consensus metadata
I20260807 00:35:00.188910 10003 catalog_manager.cc:4841] TS d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309): tablet 518be37bd52249c5b9afd4079df83558 (table test-table [id=334af639b6644030968877dd1596404c]) successfully deleted
I20260807 00:35:00.189443 10003 catalog_manager.cc:4841] TS cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081): tablet 518be37bd52249c5b9afd4079df83558 (table test-table [id=334af639b6644030968877dd1596404c]) successfully deleted
W20260807 00:35:00.197925 10535 tablet.cc:2369] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:00.283453 10567 raft_consensus.cc:482] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:00.283581 10567 raft_consensus.cc:504] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.284029 10567 leader_election.cc:288] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:35:00.288645 10612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.284301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:45081 (local address 127.7.252.1:33235)
0807 00:35:00.284468 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.284481 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.284617 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.284859 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.284860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.284865 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:00.284978 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.284981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.286104 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.286105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.287544 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.287549 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.288332 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.288333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.288396 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.288401 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.288483 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.288529 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":115,"thread_start_us":92,"threads_started":1}
I20260807 00:35:00.288610 10554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.284395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:33235 (local address 127.7.252.2:45081)
0807 00:35:00.284445 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.284447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.284543 (+ 96us) server_negotiation.cc:407] Connection header received
0807 00:35:00.284728 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.284729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.284760 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.284847 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:00.285111 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.285979 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.287648 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.288224 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.288310 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.288324 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.288493 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.288542 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:35:00.289003 10331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf4a7db8f7f43baa185f97444c7c804" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914" is_pre_election: true
I20260807 00:35:00.289125 10331 raft_consensus.cc:2454] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 0.
I20260807 00:35:00.289332 10113 leader_election.cc:302] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, cf295b088d734d2d92e2e6b2298a1914; no voters:
I20260807 00:35:00.289471 10567 raft_consensus.cc:2781] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:00.289486 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.284605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:56537 (local address 127.7.252.3:37309)
0807 00:35:00.284644 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.284646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.284780 (+ 134us) server_negotiation.cc:407] Connection header received
0807 00:35:00.284914 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.284915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.284926 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.284996 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:00.285222 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.285963 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.288364 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.288921 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.288994 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.289005 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.289372 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.289412 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:35:00.289513 10567 raft_consensus.cc:482] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:00.289541 10567 raft_consensus.cc:3037] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.289773 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.284541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37309 (local address 127.7.252.1:56537)
0807 00:35:00.284716 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.284726 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.284806 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.285007 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.285007 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.285009 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:00.285073 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.285075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.286065 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.286066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.287547 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.287549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.289190 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.289191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.289275 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.289280 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.289619 (+ 339us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.289669 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":71,"thread_start_us":90,"threads_started":1}
I20260807 00:35:00.290383 10567 raft_consensus.cc:504] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.290524 10567 leader_election.cc:288] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 election: Requested vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:35:00.290861 10481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf4a7db8f7f43baa185f97444c7c804" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36a4584bd0147deb7d816c81f93d40d"
I20260807 00:35:00.290861 10482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf4a7db8f7f43baa185f97444c7c804" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36a4584bd0147deb7d816c81f93d40d" is_pre_election: true
I20260807 00:35:00.291039 10481 raft_consensus.cc:3037] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.291838 10481 raft_consensus.cc:2454] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 1.
I20260807 00:35:00.291991 10331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf4a7db8f7f43baa185f97444c7c804" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914"
I20260807 00:35:00.292068 10113 leader_election.cc:302] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, d36a4584bd0147deb7d816c81f93d40d; no voters:
I20260807 00:35:00.292086 10331 raft_consensus.cc:3037] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:00.292160 10567 raft_consensus.cc:2781] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:00.292361 10567 raft_consensus.cc:686] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 LEADER]: Becoming Leader. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Running, Role: LEADER
I20260807 00:35:00.292440 10567 consensus_queue.cc:237] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:00.293046 10331 raft_consensus.cc:2454] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 1.
I20260807 00:35:00.293222 10018 catalog_manager.cc:5495] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:00.307859 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.304906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42956 (local address 127.7.252.1:42063)
0807 00:35:00.304948 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.304949 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.304978 (+ 29us) server_negotiation.cc:407] Connection header received
0807 00:35:00.305072 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.305073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.305092 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.305170 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:00.305299 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.305772 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.306882 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.307158 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.307232 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.307400 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.307532 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.307597 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.307706 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.307736 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:35:00.314366 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.311418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:48289 (local address 127.7.252.3:37309)
0807 00:35:00.311492 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.311494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.311523 (+ 29us) server_negotiation.cc:407] Connection header received
0807 00:35:00.311582 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.311584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.311594 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.311654 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:00.311841 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.312564 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.313465 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.313768 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.313838 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.314037 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.314071 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.314125 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.314264 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.314285 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:35:00.314388 10618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.311277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37309 (local address 127.7.252.1:48289)
0807 00:35:00.311450 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.311464 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.311532 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.311675 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.311675 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.311677 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:00.311770 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.311772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.312675 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.312677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.313363 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.313366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.313858 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.313859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.313928 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.313946 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.314185 (+ 239us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.314188 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.314240 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.314283 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260807 00:35:00.317489 10331 raft_consensus.cc:1261] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Refusing update from remote peer 44e1d7f6f09940cc9f87dd076accc9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:00.317555 10481 raft_consensus.cc:1261] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Refusing update from remote peer 44e1d7f6f09940cc9f87dd076accc9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:00.317788 10567 consensus_queue.cc:1035] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:00.317936 10614 consensus_queue.cc:1035] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:00.327268 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.324067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:40887 (local address 127.7.252.1:42063)
0807 00:35:00.324110 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:00.324112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:00.324122 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:00.324145 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:00.324146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:00.324158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:00.324215 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:00.324530 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.325303 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.326464 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.326831 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.326898 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.327050 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.327080 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.327115 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:00.327190 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 00:35:00.327208 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:35:00.327313 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:00.323974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42063 (local address 127.7.252.3:40887)
0807 00:35:00.324018 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:00.324032 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:00.324084 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:00.324350 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:00.324351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:00.324353 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:00.324405 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.324406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.325468 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.325469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.326382 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:00.326386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:00.326907 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:00.326908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:00.326975 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:00.326980 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:00.327129 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:00.327131 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 00:35:00.327185 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 00:35:00.327232 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
W20260807 00:35:00.327661 10589 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 00:35:01.862260 10018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:01.862385 10018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:01.863639 10018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Sending DeleteTablet for 3 replicas of tablet acf4a7db8f7f43baa185f97444c7c804
I20260807 00:35:01.863986 10164 tablet_service.cc:1514] Processing DeleteTablet for tablet acf4a7db8f7f43baa185f97444c7c804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:42940
I20260807 00:35:01.863998 10312 tablet_service.cc:1514] Processing DeleteTablet for tablet acf4a7db8f7f43baa185f97444c7c804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:34710
I20260807 00:35:01.864271 10645 tablet_replica.cc:330] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: stopping tablet replica
I20260807 00:35:01.864349 10645 raft_consensus.cc:2229] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:01.864346 10461 tablet_service.cc:1514] Processing DeleteTablet for tablet acf4a7db8f7f43baa185f97444c7c804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36994
I20260807 00:35:01.864449 10645 raft_consensus.cc:2258] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:01.864570 10646 tablet_replica.cc:330] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: stopping tablet replica
I20260807 00:35:01.864636 10646 raft_consensus.cc:2229] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:01.864648 10647 tablet_replica.cc:330] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: stopping tablet replica
I20260807 00:35:01.864687 10646 raft_consensus.cc:2258] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:01.864705 10647 raft_consensus.cc:2229] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:01.864801 10647 raft_consensus.cc:2258] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:01.864918 10645 ts_tablet_manager.cc:1905] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:01.864981 10646 ts_tablet_manager.cc:1905] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:01.865075 10647 ts_tablet_manager.cc:1905] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:01.867271 10647 ts_tablet_manager.cc:1918] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 00:35:01.867358 10647 log.cc:1196] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/acf4a7db8f7f43baa185f97444c7c804
I20260807 00:35:01.867322 10645 ts_tablet_manager.cc:1918] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 00:35:01.867620 10647 ts_tablet_manager.cc:1939] T acf4a7db8f7f43baa185f97444c7c804 P d36a4584bd0147deb7d816c81f93d40d: Deleting consensus metadata
I20260807 00:35:01.867622 10645 log.cc:1196] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/acf4a7db8f7f43baa185f97444c7c804
I20260807 00:35:01.867846 10645 ts_tablet_manager.cc:1939] T acf4a7db8f7f43baa185f97444c7c804 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting consensus metadata
I20260807 00:35:01.867951 10646 ts_tablet_manager.cc:1918] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 00:35:01.868026 10646 log.cc:1196] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/acf4a7db8f7f43baa185f97444c7c804
I20260807 00:35:01.868316 10646 ts_tablet_manager.cc:1939] T acf4a7db8f7f43baa185f97444c7c804 P cf295b088d734d2d92e2e6b2298a1914: Deleting consensus metadata
I20260807 00:35:01.868538 10005 catalog_manager.cc:4841] TS 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063): tablet acf4a7db8f7f43baa185f97444c7c804 (table test-table [id=440be841897045589e96d194ad180df5]) successfully deleted
I20260807 00:35:01.868624 10003 catalog_manager.cc:4841] TS d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309): tablet acf4a7db8f7f43baa185f97444c7c804 (table test-table [id=440be841897045589e96d194ad180df5]) successfully deleted
I20260807 00:35:01.868708 10003 catalog_manager.cc:4841] TS cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081): tablet acf4a7db8f7f43baa185f97444c7c804 (table test-table [id=440be841897045589e96d194ad180df5]) successfully deleted
Aug 07 00:35:01 dist-test-slave-csg5 krb5kdc[9973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 00:35:01 dist-test-slave-csg5 krb5kdc[9973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:01.901633 10655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:01.885467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33500 (local address 127.7.252.62:34185)
0807 00:35:01.885643 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:01.885646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:01.885657 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:01.885811 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:01.885812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:01.885832 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:01.885943 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:01.886945 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:01.887524 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:01.888725 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:01.888973 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:01.889069 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:01.897991 (+ 8922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:01.897994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:01.897994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:01.898003 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:01.899954 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:01.900395 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:01.900397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:01.900397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:01.900551 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:01.900922 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:01.900924 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:01.900924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:01.901085 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:01.901331 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:01.901378 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 00:35:01.901489 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260807 00:35:01.904143 10018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:01.904387 10018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:01.906561 10164 tablet_service.cc:1467] Processing CreateTablet for tablet 577bc6863c4f4d8a8a0c45406a501971 (DEFAULT_TABLE table=test-table [id=927e805fe2f949c5b8e5a6d71b4fd4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:01.906724 10312 tablet_service.cc:1467] Processing CreateTablet for tablet 577bc6863c4f4d8a8a0c45406a501971 (DEFAULT_TABLE table=test-table [id=927e805fe2f949c5b8e5a6d71b4fd4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:01.906868 10164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577bc6863c4f4d8a8a0c45406a501971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:01.906880 10312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577bc6863c4f4d8a8a0c45406a501971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:01.908036 10656 tablet_bootstrap.cc:492] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Bootstrap starting.
I20260807 00:35:01.908095 10461 tablet_service.cc:1467] Processing CreateTablet for tablet 577bc6863c4f4d8a8a0c45406a501971 (DEFAULT_TABLE table=test-table [id=927e805fe2f949c5b8e5a6d71b4fd4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:01.908221 10461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577bc6863c4f4d8a8a0c45406a501971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:01.908389 10657 tablet_bootstrap.cc:492] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Bootstrap starting.
I20260807 00:35:01.908486 10656 tablet_bootstrap.cc:654] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:01.909003 10657 tablet_bootstrap.cc:654] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:01.909299 10656 tablet_bootstrap.cc:492] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: No bootstrap required, opened a new log
I20260807 00:35:01.909438 10656 ts_tablet_manager.cc:1397] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:01.909623 10656 raft_consensus.cc:348] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.909723 10656 raft_consensus.cc:374] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:01.909754 10656 raft_consensus.cc:729] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Initialized, Role: FOLLOWER
I20260807 00:35:01.909754 10657 tablet_bootstrap.cc:492] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: No bootstrap required, opened a new log
I20260807 00:35:01.909826 10656 consensus_queue.cc:260] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.909951 10661 tablet_bootstrap.cc:492] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Bootstrap starting.
I20260807 00:35:01.909974 10657 ts_tablet_manager.cc:1397] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:01.910143 10656 ts_tablet_manager.cc:1428] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:01.910136 10657 raft_consensus.cc:348] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.910210 10657 raft_consensus.cc:374] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:01.910233 10657 raft_consensus.cc:729] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf295b088d734d2d92e2e6b2298a1914, State: Initialized, Role: FOLLOWER
I20260807 00:35:01.910287 10657 consensus_queue.cc:260] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.910369 10661 tablet_bootstrap.cc:654] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:01.910488 10657 ts_tablet_manager.cc:1428] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:01.911161 10661 tablet_bootstrap.cc:492] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: No bootstrap required, opened a new log
I20260807 00:35:01.911254 10661 ts_tablet_manager.cc:1397] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:01.911397 10661 raft_consensus.cc:348] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.911490 10661 raft_consensus.cc:374] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:01.911528 10661 raft_consensus.cc:729] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Initialized, Role: FOLLOWER
I20260807 00:35:01.911587 10661 consensus_queue.cc:260] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.911720 10661 ts_tablet_manager.cc:1428] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:01.954246 10638 raft_consensus.cc:482] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:01.954372 10638 raft_consensus.cc:504] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.954571 10638 leader_election.cc:288] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:35:01.954969 10331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577bc6863c4f4d8a8a0c45406a501971" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914" is_pre_election: true
I20260807 00:35:01.955070 10331 raft_consensus.cc:2454] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 0.
I20260807 00:35:01.954986 10481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577bc6863c4f4d8a8a0c45406a501971" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36a4584bd0147deb7d816c81f93d40d" is_pre_election: true
I20260807 00:35:01.955158 10481 raft_consensus.cc:2454] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 0.
I20260807 00:35:01.955376 10113 leader_election.cc:302] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, cf295b088d734d2d92e2e6b2298a1914; no voters:
I20260807 00:35:01.955515 10638 raft_consensus.cc:2781] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:01.955559 10638 raft_consensus.cc:482] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:01.955591 10638 raft_consensus.cc:3037] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:01.956550 10638 raft_consensus.cc:504] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.956697 10638 leader_election.cc:288] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 election: Requested vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:35:01.956923 10331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577bc6863c4f4d8a8a0c45406a501971" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914"
I20260807 00:35:01.956956 10481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577bc6863c4f4d8a8a0c45406a501971" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36a4584bd0147deb7d816c81f93d40d"
I20260807 00:35:01.957015 10331 raft_consensus.cc:3037] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:01.957083 10481 raft_consensus.cc:3037] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:01.957687 10331 raft_consensus.cc:2454] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 1.
I20260807 00:35:01.957775 10481 raft_consensus.cc:2454] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 1.
I20260807 00:35:01.957893 10113 leader_election.cc:302] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, cf295b088d734d2d92e2e6b2298a1914; no voters:
I20260807 00:35:01.958039 10638 raft_consensus.cc:2781] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:01.958117 10638 raft_consensus.cc:686] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 LEADER]: Becoming Leader. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Running, Role: LEADER
I20260807 00:35:01.958174 10638 consensus_queue.cc:237] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:01.958897 10018 catalog_manager.cc:5495] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:01.977128 10667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:01.974018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42970 (local address 127.7.252.1:42063)
0807 00:35:01.974220 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:01.974222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:01.974231 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:01.974269 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:01.974270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:01.974281 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:01.974390 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:01.974572 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:01.975295 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:01.976174 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:01.976478 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:01.976574 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:01.976773 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:01.976816 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:01.976909 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:01.976982 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 00:35:01.977011 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260807 00:35:01.980490 10481 raft_consensus.cc:1261] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Refusing update from remote peer 44e1d7f6f09940cc9f87dd076accc9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:01.980513 10331 raft_consensus.cc:1261] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Refusing update from remote peer 44e1d7f6f09940cc9f87dd076accc9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:01.980765 10635 consensus_queue.cc:1035] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:01.980901 10638 consensus_queue.cc:1035] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:01.993053 10018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:01.993175 10018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:01.994086 10018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Sending DeleteTablet for 3 replicas of tablet 577bc6863c4f4d8a8a0c45406a501971
I20260807 00:35:01.994403 10164 tablet_service.cc:1514] Processing DeleteTablet for tablet 577bc6863c4f4d8a8a0c45406a501971 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:42940
I20260807 00:35:01.994527 10645 tablet_replica.cc:330] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: stopping tablet replica
I20260807 00:35:01.994534 10312 tablet_service.cc:1514] Processing DeleteTablet for tablet 577bc6863c4f4d8a8a0c45406a501971 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:34710
I20260807 00:35:01.994592 10645 raft_consensus.cc:2229] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:01.994576 10461 tablet_service.cc:1514] Processing DeleteTablet for tablet 577bc6863c4f4d8a8a0c45406a501971 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36994
I20260807 00:35:01.994654 10645 raft_consensus.cc:2258] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:01.994690 10647 tablet_replica.cc:330] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: stopping tablet replica
I20260807 00:35:01.994683 10646 tablet_replica.cc:330] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: stopping tablet replica
I20260807 00:35:01.994798 10647 raft_consensus.cc:2229] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:01.994823 10646 raft_consensus.cc:2229] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:01.994858 10647 raft_consensus.cc:2258] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:01.994882 10646 raft_consensus.cc:2258] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:01.995244 10646 ts_tablet_manager.cc:1905] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:01.995218 10647 ts_tablet_manager.cc:1905] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:01.995249 10018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:01.995407 10018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:01.997125 10645 ts_tablet_manager.cc:1905] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:01.997534 10646 ts_tablet_manager.cc:1918] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:01.997602 10646 log.cc:1196] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/577bc6863c4f4d8a8a0c45406a501971
I20260807 00:35:01.997850 10646 ts_tablet_manager.cc:1939] T 577bc6863c4f4d8a8a0c45406a501971 P cf295b088d734d2d92e2e6b2298a1914: Deleting consensus metadata
I20260807 00:35:01.998205 10003 catalog_manager.cc:4841] TS cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081): tablet 577bc6863c4f4d8a8a0c45406a501971 (table test-table [id=927e805fe2f949c5b8e5a6d71b4fd4f9]) successfully deleted
I20260807 00:35:01.998942 10645 ts_tablet_manager.cc:1918] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:01.999009 10645 log.cc:1196] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/577bc6863c4f4d8a8a0c45406a501971
I20260807 00:35:01.999060 10647 ts_tablet_manager.cc:1918] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:01.999128 10647 log.cc:1196] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/577bc6863c4f4d8a8a0c45406a501971
I20260807 00:35:01.999233 10645 ts_tablet_manager.cc:1939] T 577bc6863c4f4d8a8a0c45406a501971 P 44e1d7f6f09940cc9f87dd076accc9d8: Deleting consensus metadata
I20260807 00:35:01.999353 10647 ts_tablet_manager.cc:1939] T 577bc6863c4f4d8a8a0c45406a501971 P d36a4584bd0147deb7d816c81f93d40d: Deleting consensus metadata
I20260807 00:35:01.999456 10164 tablet_service.cc:1467] Processing CreateTablet for tablet 03902b936132477396db744fa9f60a21 (DEFAULT_TABLE table=test-table [id=4cfd8e55839b4965b5e64370e4f8964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:01.999586 10164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03902b936132477396db744fa9f60a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:01.999598 10312 tablet_service.cc:1467] Processing CreateTablet for tablet 03902b936132477396db744fa9f60a21 (DEFAULT_TABLE table=test-table [id=4cfd8e55839b4965b5e64370e4f8964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:01.999665 10461 tablet_service.cc:1467] Processing CreateTablet for tablet 03902b936132477396db744fa9f60a21 (DEFAULT_TABLE table=test-table [id=4cfd8e55839b4965b5e64370e4f8964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:01.999708 10312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03902b936132477396db744fa9f60a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:01.999773 10461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03902b936132477396db744fa9f60a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:01.999764 10005 catalog_manager.cc:4841] TS 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063): tablet 577bc6863c4f4d8a8a0c45406a501971 (table test-table [id=927e805fe2f949c5b8e5a6d71b4fd4f9]) successfully deleted
I20260807 00:35:01.999843 10003 catalog_manager.cc:4841] TS d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309): tablet 577bc6863c4f4d8a8a0c45406a501971 (table test-table [id=927e805fe2f949c5b8e5a6d71b4fd4f9]) successfully deleted
I20260807 00:35:02.001097 10656 tablet_bootstrap.cc:492] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8: Bootstrap starting.
I20260807 00:35:02.001286 10657 tablet_bootstrap.cc:492] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: Bootstrap starting.
I20260807 00:35:02.001443 10656 tablet_bootstrap.cc:654] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:02.001499 10661 tablet_bootstrap.cc:492] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Bootstrap starting.
I20260807 00:35:02.001677 10657 tablet_bootstrap.cc:654] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:02.001871 10661 tablet_bootstrap.cc:654] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:02.002226 10656 tablet_bootstrap.cc:492] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8: No bootstrap required, opened a new log
I20260807 00:35:02.002290 10656 ts_tablet_manager.cc:1397] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:02.002478 10661 tablet_bootstrap.cc:492] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: No bootstrap required, opened a new log
I20260807 00:35:02.002449 10656 raft_consensus.cc:348] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.002532 10656 raft_consensus.cc:374] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:02.002537 10661 ts_tablet_manager.cc:1397] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:02.002559 10656 raft_consensus.cc:729] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Initialized, Role: FOLLOWER
I20260807 00:35:02.002617 10656 consensus_queue.cc:260] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.002713 10661 raft_consensus.cc:348] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.002776 10656 ts_tablet_manager.cc:1428] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 00:35:02.002794 10661 raft_consensus.cc:374] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:02.002820 10661 raft_consensus.cc:729] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36a4584bd0147deb7d816c81f93d40d, State: Initialized, Role: FOLLOWER
I20260807 00:35:02.002876 10661 consensus_queue.cc:260] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.002990 10661 ts_tablet_manager.cc:1428] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 00:35:02.003428 10657 tablet_bootstrap.cc:492] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: No bootstrap required, opened a new log
I20260807 00:35:02.003496 10657 ts_tablet_manager.cc:1397] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:02.003679 10657 raft_consensus.cc:348] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.003762 10657 raft_consensus.cc:374] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:02.003778 10657 raft_consensus.cc:729] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf295b088d734d2d92e2e6b2298a1914, State: Initialized, Role: FOLLOWER
I20260807 00:35:02.003839 10657 consensus_queue.cc:260] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.003942 10657 ts_tablet_manager.cc:1428] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:02.034947 10567 raft_consensus.cc:482] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:02.035064 10567 raft_consensus.cc:504] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.035204 10567 leader_election.cc:288] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:35:02.035542 10331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03902b936132477396db744fa9f60a21" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914" is_pre_election: true
I20260807 00:35:02.035673 10331 raft_consensus.cc:2454] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 0.
I20260807 00:35:02.035609 10481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03902b936132477396db744fa9f60a21" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36a4584bd0147deb7d816c81f93d40d" is_pre_election: true
I20260807 00:35:02.035863 10481 raft_consensus.cc:2454] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 0.
I20260807 00:35:02.035929 10113 leader_election.cc:302] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, cf295b088d734d2d92e2e6b2298a1914; no voters:
I20260807 00:35:02.036079 10567 raft_consensus.cc:2781] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:02.036131 10567 raft_consensus.cc:482] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:02.036147 10567 raft_consensus.cc:3037] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:02.036918 10567 raft_consensus.cc:504] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.037043 10567 leader_election.cc:288] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 election: Requested vote from peers cf295b088d734d2d92e2e6b2298a1914 (127.7.252.2:45081), d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309)
I20260807 00:35:02.037323 10331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03902b936132477396db744fa9f60a21" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf295b088d734d2d92e2e6b2298a1914"
I20260807 00:35:02.037451 10331 raft_consensus.cc:3037] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:02.037436 10481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03902b936132477396db744fa9f60a21" candidate_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36a4584bd0147deb7d816c81f93d40d"
I20260807 00:35:02.037534 10481 raft_consensus.cc:3037] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:02.038436 10481 raft_consensus.cc:2454] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 1.
I20260807 00:35:02.038436 10331 raft_consensus.cc:2454] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44e1d7f6f09940cc9f87dd076accc9d8 in term 1.
I20260807 00:35:02.038640 10113 leader_election.cc:302] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44e1d7f6f09940cc9f87dd076accc9d8, d36a4584bd0147deb7d816c81f93d40d; no voters:
I20260807 00:35:02.038909 10567 raft_consensus.cc:2781] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:02.039013 10567 raft_consensus.cc:686] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [term 1 LEADER]: Becoming Leader. State: Replica: 44e1d7f6f09940cc9f87dd076accc9d8, State: Running, Role: LEADER
I20260807 00:35:02.039079 10567 consensus_queue.cc:237] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } }
I20260807 00:35:02.039788 10018 catalog_manager.cc:5495] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44e1d7f6f09940cc9f87dd076accc9d8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:02.055361 10331 raft_consensus.cc:1261] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Refusing update from remote peer 44e1d7f6f09940cc9f87dd076accc9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:02.055380 10481 raft_consensus.cc:1261] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Refusing update from remote peer 44e1d7f6f09940cc9f87dd076accc9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:02.055658 10635 consensus_queue.cc:1035] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf295b088d734d2d92e2e6b2298a1914" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:02.055826 10567 consensus_queue.cc:1035] T 03902b936132477396db744fa9f60a21 P 44e1d7f6f09940cc9f87dd076accc9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d36a4584bd0147deb7d816c81f93d40d" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 00:35:02.061085 10626 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 00:35:03.584391 10017 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:03.584568 10017 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:03.586038 10017 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b62cee92244457b8f9f9cd68c07b462: Sending DeleteTablet for 3 replicas of tablet 03902b936132477396db744fa9f60a21
I20260807 00:35:03.586541 10164 tablet_service.cc:1514] Processing DeleteTablet for tablet 03902b936132477396db744fa9f60a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:03 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:42940
I20260807 00:35:03.586577 10461 tablet_service.cc:1514] Processing DeleteTablet for tablet 03902b936132477396db744fa9f60a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:03 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36994
I20260807 00:35:03.586565 10312 tablet_service.cc:1514] Processing DeleteTablet for tablet 03902b936132477396db744fa9f60a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:03 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:34710
I20260807 00:35:03.586902 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 10096
I20260807 00:35:03.590293 10702 tablet_replica.cc:330] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: stopping tablet replica
I20260807 00:35:03.590426 10702 raft_consensus.cc:2229] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:03.590494 10702 raft_consensus.cc:2258] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:03.590951 10702 ts_tablet_manager.cc:1905] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:03.593073 10702 ts_tablet_manager.cc:1918] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 00:35:03.593161 10702 log.cc:1196] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/03902b936132477396db744fa9f60a21
I20260807 00:35:03.593436 10702 ts_tablet_manager.cc:1939] T 03902b936132477396db744fa9f60a21 P d36a4584bd0147deb7d816c81f93d40d: Deleting consensus metadata
I20260807 00:35:03.593984 10003 catalog_manager.cc:4841] TS d36a4584bd0147deb7d816c81f93d40d (127.7.252.3:37309): tablet 03902b936132477396db744fa9f60a21 (table test-table [id=4cfd8e55839b4965b5e64370e4f8964f]) successfully deleted
I20260807 00:35:03.594921 10704 tablet_replica.cc:330] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: stopping tablet replica
I20260807 00:35:03.594997 10704 raft_consensus.cc:2229] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:03.595086 10704 raft_consensus.cc:2258] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:03.595634 10704 ts_tablet_manager.cc:1905] T 03902b936132477396db744fa9f60a21 P cf295b088d734d2d92e2e6b2298a1914: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 00:35:03.596931 10005 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:42063 (error 108)
I20260807 00:35:03.597700 10706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:03.597433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42063 (local address 127.0.0.1:42972)
0807 00:35:03.597592 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:03.597650 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260807 00:35:03.597685 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 10245
W20260807 00:35:03.599607 10005 catalog_manager.cc:4584] TS 44e1d7f6f09940cc9f87dd076accc9d8 (127.7.252.1:42063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03902b936132477396db744fa9f60a21: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42063: connect: Connection refused (error 111)
I20260807 00:35:03.603627 10706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:03.603477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:45081 (local address 127.0.0.1:34726)
0807 00:35:03.603553 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:03.603590 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.2:45081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 00:35:03.603914 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 10390
I20260807 00:35:03.611238 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 9986
2026-08-07T00:35:03Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5661 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:03 dist-test-slave-csg5 krb5kdc[10709](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:03 dist-test-slave-csg5 krb5kdc[10709](info): set up 2 sockets
Aug 07 00:35:03 dist-test-slave-csg5 krb5kdc[10709](info): commencing operation
krb5kdc: starting...
W20260807 00:35:04.773084 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:04 dist-test-slave-csg5 krb5kdc[10709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:04.923341 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41417
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:36629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:05.017061 10722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:05.017392 10722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:05.017441 10722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:05.019117 10722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:05.019201 10722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:05.019228 10722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:05.019256 10722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:05.019289 10722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:05.021040 10722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:36629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:05.021374 10722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:05.021638 10722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:05.027343 10730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.027446 10727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:05.027355 10722 server_base.cc:1034] running on GCE node
W20260807 00:35:05.027245 10728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:05.027949 10722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:05.028318 10722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:05.029551 10722 hybrid_clock.cc:648] HybridClock initialized: now 1786062905029507 us; error 59 us; skew 500 ppm
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:05.033143 10722 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:05.033962 10722 webserver.cc:460] Webserver started at http://127.7.252.62:41863/ using document root <none> and password file <none>
I20260807 00:35:05.034231 10722 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:05.034307 10722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:05.034474 10722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:05.035789 10722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "f070848b409e450999be8ce934ff7408"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "96c4c0f1c4708a7a19230a476b6a0b03"
server_key_iv: "d01d9d428b35947c9ceb38c52d594671"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.036191 10722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "f070848b409e450999be8ce934ff7408"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "96c4c0f1c4708a7a19230a476b6a0b03"
server_key_iv: "d01d9d428b35947c9ceb38c52d594671"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.037752 10722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:05.038985 10738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.039302 10722 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:05.039443 10722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "f070848b409e450999be8ce934ff7408"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "96c4c0f1c4708a7a19230a476b6a0b03"
server_key_iv: "d01d9d428b35947c9ceb38c52d594671"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.039541 10722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:05.057257 10722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:05.060041 10722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:05.060385 10722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:05.064939 10722 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41417
I20260807 00:35:05.065019 10795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41417 every 8 connection(s)
I20260807 00:35:05.065411 10722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:05.066434 10796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:05.068913 10796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408: Bootstrap starting.
I20260807 00:35:05.069561 10796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:05.069893 10796 log.cc:824] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:05.070638 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 10722
I20260807 00:35:05.070848 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:05.071066 8176 external_mini_cluster.cc:1428] Setting key bceeeadbee5aa0503309206d41402129
I20260807 00:35:05.071206 10796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408: No bootstrap required, opened a new log
I20260807 00:35:05.073262 10796 raft_consensus.cc:348] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f070848b409e450999be8ce934ff7408" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41417 } }
I20260807 00:35:05.073446 10796 raft_consensus.cc:374] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:05.073485 10796 raft_consensus.cc:729] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f070848b409e450999be8ce934ff7408, State: Initialized, Role: FOLLOWER
I20260807 00:35:05.073660 10796 consensus_queue.cc:260] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f070848b409e450999be8ce934ff7408" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41417 } }
I20260807 00:35:05.073764 10796 raft_consensus.cc:388] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:05.073822 10796 raft_consensus.cc:482] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:05.073876 10796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:05.074915 10796 raft_consensus.cc:504] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f070848b409e450999be8ce934ff7408" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41417 } }
I20260807 00:35:05.075047 10796 leader_election.cc:302] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f070848b409e450999be8ce934ff7408; no voters:
I20260807 00:35:05.075529 10796 leader_election.cc:288] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:05.075552 10801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:05.075692 10801 raft_consensus.cc:686] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [term 1 LEADER]: Becoming Leader. State: Replica: f070848b409e450999be8ce934ff7408, State: Running, Role: LEADER
I20260807 00:35:05.075878 10796 sys_catalog.cc:564] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:05.075901 10801 consensus_queue.cc:237] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f070848b409e450999be8ce934ff7408" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41417 } }
I20260807 00:35:05.076373 10802 sys_catalog.cc:455] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f070848b409e450999be8ce934ff7408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f070848b409e450999be8ce934ff7408" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41417 } } }
I20260807 00:35:05.076423 10803 sys_catalog.cc:455] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f070848b409e450999be8ce934ff7408. Latest consensus state: current_term: 1 leader_uuid: "f070848b409e450999be8ce934ff7408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f070848b409e450999be8ce934ff7408" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41417 } } }
I20260807 00:35:05.076561 10802 sys_catalog.cc:458] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:05.076670 10803 sys_catalog.cc:458] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408 [sys.catalog]: This master's current role is: LEADER
W20260807 00:35:05.078151 10818 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:35:05.078225 10818 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:35:05.078554 10811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:05.078864 10811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:05.081228 10811 catalog_manager.cc:1347] Generated new cluster ID: ff60c7b92c774f91be63e00810f74123
I20260807 00:35:05.081322 10811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:05.085516 10800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.071898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41084 (local address 127.7.252.62:41417)
0807 00:35:05.072097 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:05.072106 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:05.072136 (+ 30us) server_negotiation.cc:407] Connection header received
0807 00:35:05.073254 (+ 1118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:05.073264 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:05.073335 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:05.073545 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:05.074386 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.075670 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.076880 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.077689 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.077806 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.081227 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:05.081232 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:05.081232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:05.081246 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:05.083519 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.083997 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.084001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.084001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.084150 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.084385 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.084386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.084386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.084771 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:05.084971 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:05.085064 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 00:35:05.085273 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260807 00:35:05.087450 10811 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:05.088056 10811 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:05.091955 10811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f070848b409e450999be8ce934ff7408: Generated new TSK 0
I20260807 00:35:05.092175 10811 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:05.131284 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41417
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:36629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:05.224035 10824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:05.224279 10824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:05.224309 10824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:05.225622 10824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:05.225682 10824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:05.225714 10824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:05.227310 10824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:36629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:05.227546 10824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:05.227759 10824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:05.234411 10829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.234273 10832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.234273 10830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:05.235069 10824 server_base.cc:1034] running on GCE node
I20260807 00:35:05.235344 10824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:05.235692 10824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:05.236996 10824 hybrid_clock.cc:648] HybridClock initialized: now 1786062905236976 us; error 43 us; skew 500 ppm
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:05.240191 10824 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:05.240835 10824 webserver.cc:460] Webserver started at http://127.7.252.1:38003/ using document root <none> and password file <none>
I20260807 00:35:05.241091 10824 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:05.241164 10824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:05.241359 10824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:05.242594 10824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "2df2445bc0ac4152a7f31e4a50745a44"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "d9016bcaf26cc4ef49415e9577226122"
server_key_iv: "35bc2e353c835272e7db51d55a78576e"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.243046 10824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "2df2445bc0ac4152a7f31e4a50745a44"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "d9016bcaf26cc4ef49415e9577226122"
server_key_iv: "35bc2e353c835272e7db51d55a78576e"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.244753 10824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:05.245857 10839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.246104 10824 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:05.246215 10824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "2df2445bc0ac4152a7f31e4a50745a44"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "d9016bcaf26cc4ef49415e9577226122"
server_key_iv: "35bc2e353c835272e7db51d55a78576e"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.246366 10824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:05.261222 10824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:05.264056 10824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:05.264405 10824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:05.264685 10824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:05.265057 10824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:05.265117 10824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.265179 10824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:05.265206 10824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.271934 10824 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:40731
I20260807 00:35:05.272006 10961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:40731 every 8 connection(s)
I20260807 00:35:05.272358 10824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:05.277889 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 10824
I20260807 00:35:05.278013 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:05.278235 8176 external_mini_cluster.cc:1428] Setting key f32b41e0d846eec5636b74bf5d084b08
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:05.284875 10800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.273198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:37221 (local address 127.7.252.62:41417)
0807 00:35:05.273260 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:05.273262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:05.273466 (+ 204us) server_negotiation.cc:407] Connection header received
0807 00:35:05.273968 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:05.273970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:05.273981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:05.274049 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:05.275119 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.275646 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.277343 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.277649 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.277721 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.281118 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:05.281120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:05.281121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:05.281135 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:05.282989 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.283636 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.283637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.283637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.283698 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.284031 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.284032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.284032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.284211 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:05.284301 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:05.284716 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 00:35:05.284806 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:05.285189 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.273137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41417 (local address 127.7.252.1:37221)
0807 00:35:05.273313 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:05.273366 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:05.273866 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:05.274104 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:05.274108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:05.274799 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:05.275013 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:05.275019 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.275854 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.275855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:05.277218 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:05.277222 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.277773 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.277775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:05.277951 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.278953 (+ 1002us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:05.278965 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:05.281002 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:05.283082 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:05.283092 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:05.283095 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:05.283547 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:05.283781 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:05.283782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:05.283783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:05.283952 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:05.284299 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:05.284320 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:05.284520 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 00:35:05.284651 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 00:35:05.284861 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260807 00:35:05.285817 10962 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41417
I20260807 00:35:05.285915 10962 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:05.286125 10962 heartbeater.cc:511] Master 127.7.252.62:41417 requested a full tablet report, sending...
I20260807 00:35:05.286935 10756 ts_manager.cc:194] Registered new tserver with Master: 2df2445bc0ac4152a7f31e4a50745a44 (127.7.252.1:40731)
I20260807 00:35:05.287678 10756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:37221
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:05.311551 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41417
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:36629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:05.405408 10967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:05.405653 10967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:05.405680 10967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:05.406883 10967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:05.406924 10967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:05.406950 10967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:05.408532 10967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:36629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:05.408749 10967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:05.408946 10967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:05.414251 10972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.414258 10975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.414273 10973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:05.414502 10967 server_base.cc:1034] running on GCE node
I20260807 00:35:05.414873 10967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:05.415107 10967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:05.416321 10967 hybrid_clock.cc:648] HybridClock initialized: now 1786062905416313 us; error 38 us; skew 500 ppm
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:05.419468 10967 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:05.420017 10967 webserver.cc:460] Webserver started at http://127.7.252.2:36381/ using document root <none> and password file <none>
I20260807 00:35:05.420274 10967 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:05.420347 10967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:05.420508 10967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:05.421667 10967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "29f304e842a443899978ceb08051b46c"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "78563e8e258fa0207bf33ba2c1166023"
server_key_iv: "4c97586ff0b1aaedcd9d7387b1b63fbd"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.422062 10967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "29f304e842a443899978ceb08051b46c"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "78563e8e258fa0207bf33ba2c1166023"
server_key_iv: "4c97586ff0b1aaedcd9d7387b1b63fbd"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.423627 10967 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:05.424679 10982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.425010 10967 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:05.425136 10967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "29f304e842a443899978ceb08051b46c"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "78563e8e258fa0207bf33ba2c1166023"
server_key_iv: "4c97586ff0b1aaedcd9d7387b1b63fbd"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.425241 10967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:05.446503 10967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:05.449285 10967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:05.449493 10967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:05.449802 10967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:05.450245 10967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:05.450307 10967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.450348 10967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:05.450374 10967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.457580 10967 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:37247
I20260807 00:35:05.457655 11106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:37247 every 8 connection(s)
I20260807 00:35:05.458061 10967 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:05.458561 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 10967
I20260807 00:35:05.458729 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:05.458918 8176 external_mini_cluster.cc:1428] Setting key 527c14a40fa58a0a51d91188eb3c4a09
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:35:05.471369 10800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.459042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58299 (local address 127.7.252.62:41417)
0807 00:35:05.459119 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:05.459121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:05.459446 (+ 325us) server_negotiation.cc:407] Connection header received
0807 00:35:05.460303 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:05.460304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:05.460315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:05.460378 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:05.461981 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.462951 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.464128 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.464514 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.464611 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.467281 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:05.467283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:05.467284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:05.467294 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:05.469298 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.469921 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.469922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.469922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.470055 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.470392 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.470392 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.470393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.470526 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:05.470587 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:05.471107 (+ 520us) server_negotiation.cc:299] Negotiation successful
0807 00:35:05.471206 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 00:35:05.471446 11109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.459042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41417 (local address 127.7.252.2:58299)
0807 00:35:05.459267 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:05.459327 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:05.460121 (+ 794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:05.460497 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:05.460502 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:05.461506 (+ 1004us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:05.461845 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:05.461852 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.463084 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.463085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:05.464021 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:05.464024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.464641 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.464642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:05.464781 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.465487 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:05.465497 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:05.467159 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:05.469463 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:05.469472 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:05.469474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:05.469807 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:05.470155 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:05.470156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:05.470156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:05.470304 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:05.470616 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:05.470623 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:05.470869 (+ 246us) client_negotiation.cc:769] Sending connection context
0807 00:35:05.471025 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 00:35:05.471251 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":105,"threads_started":1}
I20260807 00:35:05.472141 11107 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41417
I20260807 00:35:05.472245 11107 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:05.472472 11107 heartbeater.cc:511] Master 127.7.252.62:41417 requested a full tablet report, sending...
I20260807 00:35:05.473006 10756 ts_manager.cc:194] Registered new tserver with Master: 29f304e842a443899978ceb08051b46c (127.7.252.2:37247)
I20260807 00:35:05.473507 10756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:58299
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:05.496011 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41417
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:36629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:05.583606 11112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:05.583855 11112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:05.583897 11112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:05.585217 11112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:05.585316 11112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:05.585374 11112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:05.586997 11112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:36629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:05.587287 11112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:05.587546 11112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:05.592928 11120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.592955 11118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:05.592941 11117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:05.593314 11112 server_base.cc:1034] running on GCE node
I20260807 00:35:05.593588 11112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:05.593803 11112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:05.594945 11112 hybrid_clock.cc:648] HybridClock initialized: now 1786062905594927 us; error 42 us; skew 500 ppm
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:05.597647 11112 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:05.598176 11112 webserver.cc:460] Webserver started at http://127.7.252.3:42887/ using document root <none> and password file <none>
I20260807 00:35:05.598424 11112 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:05.598470 11112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:05.598620 11112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:05.599798 11112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "e00ac4814d214e208b19f8ac9ce92495"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "3ae33beb2a480603f72e08fe2a9b71be"
server_key_iv: "3b398c18a95c5301d2abb234e038db3f"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.600172 11112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "e00ac4814d214e208b19f8ac9ce92495"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "3ae33beb2a480603f72e08fe2a9b71be"
server_key_iv: "3b398c18a95c5301d2abb234e038db3f"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.601655 11112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:05.602721 11127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.602907 11112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:05.603018 11112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "e00ac4814d214e208b19f8ac9ce92495"
format_stamp: "Formatted at 2026-08-07 00:35:05 on dist-test-slave-csg5"
server_key: "3ae33beb2a480603f72e08fe2a9b71be"
server_key_iv: "3b398c18a95c5301d2abb234e038db3f"
server_key_version: "encryptionkey@0"
I20260807 00:35:05.603089 11112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:05.613449 11112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:05.615649 11112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:05.615818 11112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:05.616031 11112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:05.616392 11112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:05.616456 11112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.616505 11112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:05.616534 11112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:05.623562 11112 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:34711
I20260807 00:35:05.623646 11251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:34711 every 8 connection(s)
I20260807 00:35:05.624001 11112 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[10709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062905, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:05.633484 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11112
I20260807 00:35:05.633589 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:05.633858 8176 external_mini_cluster.cc:1428] Setting key 10c911c100622c29dd0422d400b15b94
I20260807 00:35:05.634519 10800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.624833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:51467 (local address 127.7.252.62:41417)
0807 00:35:05.624906 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:05.624908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:05.625105 (+ 197us) server_negotiation.cc:407] Connection header received
0807 00:35:05.625669 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:05.625670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:05.625684 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:05.625724 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:05.626809 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.627334 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.628379 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.628620 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.628700 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.631312 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:05.631313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:05.631313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:05.631322 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:05.632803 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.633197 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.633198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.633198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.633259 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:05.633611 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:05.633612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:05.633612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:05.633755 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:05.633823 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:05.634180 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 00:35:05.634406 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:35:05.634630 11254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:05.624821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41417 (local address 127.7.252.3:51467)
0807 00:35:05.624981 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:05.625020 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:05.625549 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:05.625834 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:05.625838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:05.626460 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:05.626703 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:05.626709 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.627435 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.627436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:05.628248 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:05.628250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:05.628708 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:05.628709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:05.628850 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:05.629517 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:05.629530 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:05.631209 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:05.632887 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:05.632893 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:05.632895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:05.633128 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:05.633371 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:05.633372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:05.633373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:05.633527 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:05.633827 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:05.633834 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:05.634011 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 00:35:05.634142 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 00:35:05.634352 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260807 00:35:05.635299 11252 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41417
I20260807 00:35:05.635402 11252 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:05.635550 11252 heartbeater.cc:511] Master 127.7.252.62:41417 requested a full tablet report, sending...
I20260807 00:35:05.635974 10756 ts_manager.cc:194] Registered new tserver with Master: e00ac4814d214e208b19f8ac9ce92495 (127.7.252.3:34711)
I20260807 00:35:05.636476 10756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:51467
I20260807 00:35:05.646210 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 00:35:05.659585 10800 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:05.658386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41098 (local address 127.7.252.62:41417)
0807 00:35:05.658476 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:05.658478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:05.658579 (+ 101us) server_negotiation.cc:407] Connection header received
0807 00:35:05.658710 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:05.658711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:05.658725 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:05.658807 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:05.659477 (+ 670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41098: BlockingRecv error: recv got EOF from 127.0.0.1:41098 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:35:05.660701 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 10824
I20260807 00:35:05.666751 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 10967
I20260807 00:35:05.672878 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11112
I20260807 00:35:05.679129 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 10722
2026-08-07T00:35:05Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2066 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[11264](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[11264](info): set up 2 sockets
Aug 07 00:35:05 dist-test-slave-csg5 krb5kdc[11264](info): commencing operation
krb5kdc: starting...
W20260807 00:35:06.789865 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:06 dist-test-slave-csg5 krb5kdc[11264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:06.935349 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41423
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:39063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:07.026207 11277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:07.026460 11277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:07.026485 11277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:07.027777 11277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:07.027827 11277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:07.027842 11277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:07.027855 11277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:07.027868 11277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:07.029515 11277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:39063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:07.029814 11277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:07.030063 11277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:07.035555 11284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:07.035744 11277 server_base.cc:1034] running on GCE node
W20260807 00:35:07.035567 11285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:07.035588 11287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:07.036187 11277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:07.036571 11277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:07.037815 11277 hybrid_clock.cc:648] HybridClock initialized: now 1786062907037782 us; error 34 us; skew 500 ppm
Aug 07 00:35:07 dist-test-slave-csg5 krb5kdc[11264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062907, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:07.047196 11277 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:07.047775 11277 webserver.cc:460] Webserver started at http://127.7.252.62:37715/ using document root <none> and password file <none>
I20260807 00:35:07.048072 11277 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:07.048130 11277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:07.048291 11277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:07.049588 11277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "1efd22298c1b4076a080a1ed125a678a"
format_stamp: "Formatted at 2026-08-07 00:35:07 on dist-test-slave-csg5"
server_key: "68d23d6672022bb3211543242db19f24"
server_key_iv: "fb0d9ba7ded56b241ac8f6e3218c074a"
server_key_version: "encryptionkey@0"
I20260807 00:35:07.050060 11277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "1efd22298c1b4076a080a1ed125a678a"
format_stamp: "Formatted at 2026-08-07 00:35:07 on dist-test-slave-csg5"
server_key: "68d23d6672022bb3211543242db19f24"
server_key_iv: "fb0d9ba7ded56b241ac8f6e3218c074a"
server_key_version: "encryptionkey@0"
I20260807 00:35:07.051791 11277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260807 00:35:07.052891 11294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:07.053260 11277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:07.053411 11277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "1efd22298c1b4076a080a1ed125a678a"
format_stamp: "Formatted at 2026-08-07 00:35:07 on dist-test-slave-csg5"
server_key: "68d23d6672022bb3211543242db19f24"
server_key_iv: "fb0d9ba7ded56b241ac8f6e3218c074a"
server_key_version: "encryptionkey@0"
I20260807 00:35:07.053515 11277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:07.071331 11277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:07.073731 11277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:07.073944 11277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:07.078347 11277 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41423
I20260807 00:35:07.078388 11350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41423 every 8 connection(s)
I20260807 00:35:07.078770 11277 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:07.079795 11351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:07.082211 11351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a: Bootstrap starting.
I20260807 00:35:07.082249 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11277
I20260807 00:35:07.082355 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:07.082546 8176 external_mini_cluster.cc:1428] Setting key 42f8174c582801990b3f690e079bb50e
I20260807 00:35:07.083107 11351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:07.083475 11351 log.cc:824] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:07.084460 11351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a: No bootstrap required, opened a new log
I20260807 00:35:07.087100 11351 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efd22298c1b4076a080a1ed125a678a" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41423 } }
I20260807 00:35:07.087327 11351 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:07.087378 11351 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1efd22298c1b4076a080a1ed125a678a, State: Initialized, Role: FOLLOWER
I20260807 00:35:07.087559 11351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efd22298c1b4076a080a1ed125a678a" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41423 } }
I20260807 00:35:07.087649 11351 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:07.087677 11351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:07.087756 11351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:07.088595 11351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efd22298c1b4076a080a1ed125a678a" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41423 } }
I20260807 00:35:07.088739 11351 leader_election.cc:302] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1efd22298c1b4076a080a1ed125a678a; no voters:
I20260807 00:35:07.088985 11351 leader_election.cc:288] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:07.089160 11356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:07.089323 11351 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:07.089387 11356 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [term 1 LEADER]: Becoming Leader. State: Replica: 1efd22298c1b4076a080a1ed125a678a, State: Running, Role: LEADER
I20260807 00:35:07.089588 11356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efd22298c1b4076a080a1ed125a678a" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41423 } }
I20260807 00:35:07.089993 11357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1efd22298c1b4076a080a1ed125a678a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efd22298c1b4076a080a1ed125a678a" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41423 } } }
I20260807 00:35:07.090075 11357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:07.090226 11358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1efd22298c1b4076a080a1ed125a678a. Latest consensus state: current_term: 1 leader_uuid: "1efd22298c1b4076a080a1ed125a678a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1efd22298c1b4076a080a1ed125a678a" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41423 } } }
I20260807 00:35:07.090283 11358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:07.090756 11365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 07 00:35:07 dist-test-slave-csg5 krb5kdc[11264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:07.091264 11365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:07.093045 11365 catalog_manager.cc:1347] Generated new cluster ID: aa4f903083c947bbbd84c5643e3dad1c
I20260807 00:35:07.093112 11365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:07.096513 11354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:07.083181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54274 (local address 127.7.252.62:41423)
0807 00:35:07.083350 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:07.083357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:07.083385 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:35:07.084003 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:07.084011 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:07.084064 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:07.084185 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:07.085274 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:07.086147 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:07.087549 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:07.088092 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:07.088181 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:07.092195 (+ 4014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:07.092199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:07.092200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:07.092213 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:07.094693 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:07.095149 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:07.095153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:07.095153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:07.095268 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:07.095506 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:07.095507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:07.095508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:07.095841 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:07.096011 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:07.096129 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 00:35:07.096274 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260807 00:35:07.098016 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:35:07.103083 11365 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:07.103802 11365 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:07.123941 11365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1efd22298c1b4076a080a1ed125a678a: Generated new TSK 0
I20260807 00:35:07.124226 11365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:07.125347 11354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:07.120463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54284 (local address 127.7.252.62:41423)
0807 00:35:07.120512 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:07.120514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:07.120849 (+ 335us) server_negotiation.cc:407] Connection header received
0807 00:35:07.120966 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:07.120967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:07.120979 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:07.121011 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:07.121547 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:07.122391 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:07.123582 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:07.123920 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:07.124022 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:07.124802 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:07.124803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:07.124804 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:07.125016 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:07.125044 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:07.125051 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:07.125133 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:07.125218 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 00:35:07.125253 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:35:07.128522 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11277
2026-08-07T00:35:07Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1447 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:07 dist-test-slave-csg5 krb5kdc[11386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:07 dist-test-slave-csg5 krb5kdc[11386](info): set up 2 sockets
Aug 07 00:35:07 dist-test-slave-csg5 krb5kdc[11386](info): commencing operation
krb5kdc: starting...
W20260807 00:35:08.255446 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:08.391585 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:40395
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:41421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:08.479759 11400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:08.479993 11400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:08.480018 11400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:08.481369 11400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:08.481421 11400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:08.481436 11400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:08.481448 11400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:08.481460 11400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:08.483088 11400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:41421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:40395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:08.483350 11400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:08.483606 11400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:08.489192 11406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:08.489198 11405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:08.489198 11408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:08.489434 11400 server_base.cc:1034] running on GCE node
I20260807 00:35:08.489701 11400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:08.489993 11400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:08.491171 11400 hybrid_clock.cc:648] HybridClock initialized: now 1786062908491150 us; error 53 us; skew 500 ppm
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:08.493880 11400 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:08.494371 11400 webserver.cc:460] Webserver started at http://127.7.252.62:35085/ using document root <none> and password file <none>
I20260807 00:35:08.494612 11400 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:08.494709 11400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:08.494884 11400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:08.496016 11400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "6133e22003803ed36d9d5bcfbdb48f8a"
server_key_iv: "1b2ba91d1c71d6b8de1941c6effeb706"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.496411 11400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "6133e22003803ed36d9d5bcfbdb48f8a"
server_key_iv: "1b2ba91d1c71d6b8de1941c6effeb706"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.497912 11400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:08.498868 11416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.499100 11400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:08.499234 11400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "6133e22003803ed36d9d5bcfbdb48f8a"
server_key_iv: "1b2ba91d1c71d6b8de1941c6effeb706"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.499313 11400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:08.510071 11400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:08.512269 11400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:08.512444 11400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:08.516844 11400 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:40395
I20260807 00:35:08.516901 11473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:40395 every 8 connection(s)
I20260807 00:35:08.517270 11400 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:08.517876 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11400
I20260807 00:35:08.517992 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:08.518215 8176 external_mini_cluster.cc:1428] Setting key 4b19c80a29aa14f947b771e5979ea5a0
I20260807 00:35:08.518628 11474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:08.522282 11474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b: Bootstrap starting.
I20260807 00:35:08.523095 11474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:08.523450 11474 log.cc:824] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:08.524395 11474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b: No bootstrap required, opened a new log
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:08.527061 11474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40395 } }
I20260807 00:35:08.527232 11474 raft_consensus.cc:374] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:08.527281 11474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509b0dff20ec4ac9b47c4f3b6d77e40b, State: Initialized, Role: FOLLOWER
I20260807 00:35:08.527420 11474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40395 } }
I20260807 00:35:08.527518 11474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:08.527565 11474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:08.527611 11474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:08.528206 11474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40395 } }
I20260807 00:35:08.528326 11474 leader_election.cc:302] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 509b0dff20ec4ac9b47c4f3b6d77e40b; no voters:
I20260807 00:35:08.528514 11474 leader_election.cc:288] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:08.528697 11480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:08.528811 11480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [term 1 LEADER]: Becoming Leader. State: Replica: 509b0dff20ec4ac9b47c4f3b6d77e40b, State: Running, Role: LEADER
I20260807 00:35:08.528824 11474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:08.528910 11480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40395 } }
I20260807 00:35:08.529287 11480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40395 } } }
I20260807 00:35:08.529456 11480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:08.529639 11480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 509b0dff20ec4ac9b47c4f3b6d77e40b. Latest consensus state: current_term: 1 leader_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "509b0dff20ec4ac9b47c4f3b6d77e40b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40395 } } }
I20260807 00:35:08.529740 11480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:08.529912 11488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:08.530473 11488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:08.531764 11476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:08.518884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60686 (local address 127.7.252.62:40395)
0807 00:35:08.519077 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:08.519087 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:08.519220 (+ 133us) server_negotiation.cc:407] Connection header received
0807 00:35:08.520002 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:08.520010 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:08.520063 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:08.520189 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:08.521103 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.522027 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.523223 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.523867 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.524005 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:08.527153 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:08.527169 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:08.527169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:08.527181 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:08.529675 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:08.530174 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:08.530177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:08.530178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:08.530303 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:08.530544 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:08.530545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:08.530545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:08.530954 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:08.531123 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:08.531395 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 00:35:08.531543 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260807 00:35:08.532294 11488 catalog_manager.cc:1347] Generated new cluster ID: de4d227936ee47718739bdd7fcc0132f
I20260807 00:35:08.532356 11488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:08.555320 11488 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:08.556005 11488 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:08.562005 11488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 509b0dff20ec4ac9b47c4f3b6d77e40b: Generated new TSK 0
I20260807 00:35:08.562268 11488 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:08.606976 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:40395
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:41421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:08.705928 11501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:08.706154 11501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:08.706182 11501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:08.707507 11501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:08.707566 11501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:08.707597 11501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:08.709239 11501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:41421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:08.709527 11501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:08.709789 11501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:08.715543 11501 server_base.cc:1034] running on GCE node
W20260807 00:35:08.715564 11509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:08.715544 11506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:08.715809 11511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:08.716084 11501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:08.716411 11501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:08.717605 11501 hybrid_clock.cc:648] HybridClock initialized: now 1786062908717578 us; error 41 us; skew 500 ppm
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:08.720760 11501 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:08.721282 11501 webserver.cc:460] Webserver started at http://127.7.252.1:40597/ using document root <none> and password file <none>
I20260807 00:35:08.721556 11501 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:08.721632 11501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:08.721791 11501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:08.722991 11501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "abcf40f6acba4f8fa274bdf9f3ac227e"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "ea418c3d5e8eb31b6c9e98c3f60cdfef"
server_key_iv: "2440413f5bbef6cc1c24cc895a12c49f"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.723371 11501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "abcf40f6acba4f8fa274bdf9f3ac227e"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "ea418c3d5e8eb31b6c9e98c3f60cdfef"
server_key_iv: "2440413f5bbef6cc1c24cc895a12c49f"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.724937 11501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:08.725960 11520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.726258 11501 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:08.726392 11501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "abcf40f6acba4f8fa274bdf9f3ac227e"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "ea418c3d5e8eb31b6c9e98c3f60cdfef"
server_key_iv: "2440413f5bbef6cc1c24cc895a12c49f"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.726478 11501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:08.736572 11501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:08.739087 11501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:08.739274 11501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:08.739557 11501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:08.739905 11501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:08.739962 11501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.740008 11501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:08.740034 11501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.746292 11501 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:35309
I20260807 00:35:08.746433 11642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:35309 every 8 connection(s)
I20260807 00:35:08.746785 11501 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:08.754222 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11501
I20260807 00:35:08.754433 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:08.754693 8176 external_mini_cluster.cc:1428] Setting key c06ba61774a4993146b4b2e9dc26f5c5
I20260807 00:35:08.757622 11476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:08.747650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:42807 (local address 127.7.252.62:40395)
0807 00:35:08.747731 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:08.747733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:08.747962 (+ 229us) server_negotiation.cc:407] Connection header received
0807 00:35:08.748453 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:08.748454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:08.748465 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:08.748545 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:08.749568 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.750154 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.751366 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.751572 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.751641 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:08.754058 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:08.754060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:08.754060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:08.754069 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:08.756035 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:08.756547 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:08.756549 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:08.756549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:08.756620 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:08.756916 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:08.756917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:08.756917 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:08.757047 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:08.757123 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:08.757426 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 00:35:08.757526 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 00:35:08.757839 11645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:08.747616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:40395 (local address 127.7.252.1:42807)
0807 00:35:08.747791 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:08.747835 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:08.748352 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:08.748596 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:08.748599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:08.749197 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:08.749409 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:08.749414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.750258 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.750258 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:08.751277 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:08.751280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.751658 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.751659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:08.751765 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:08.752356 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:08.752392 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:08.753925 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:08.756157 (+ 2232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:08.756167 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:08.756170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:08.756462 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:08.756689 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:08.756690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:08.756690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:08.756834 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:08.757114 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:08.757122 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:08.757284 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 00:35:08.757394 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 00:35:08.757571 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260807 00:35:08.758392 11643 heartbeater.cc:347] Connected to a master server at 127.7.252.62:40395
I20260807 00:35:08.758507 11643 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:08.758770 11643 heartbeater.cc:511] Master 127.7.252.62:40395 requested a full tablet report, sending...
I20260807 00:35:08.759346 11434 ts_manager.cc:194] Registered new tserver with Master: abcf40f6acba4f8fa274bdf9f3ac227e (127.7.252.1:35309)
I20260807 00:35:08.759996 11434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:42807
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:08.786762 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:40395
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:41421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:08.880095 11649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:08.880352 11649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:08.880383 11649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:08.881666 11649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:08.881711 11649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:08.881740 11649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:08.883441 11649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:41421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:08.883659 11649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:08.883867 11649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:08.889288 11654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:08.889247 11659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:08.889263 11655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:08.889504 11649 server_base.cc:1034] running on GCE node
I20260807 00:35:08.889787 11649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:08.890010 11649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:08.891186 11649 hybrid_clock.cc:648] HybridClock initialized: now 1786062908891163 us; error 36 us; skew 500 ppm
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:08.894037 11649 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:08.894543 11649 webserver.cc:460] Webserver started at http://127.7.252.2:36659/ using document root <none> and password file <none>
I20260807 00:35:08.894838 11649 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:08.894912 11649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:08.895079 11649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:08.896260 11649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "7acb39b0703644b3ace95054d6e98e71"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "11da3ddf26c9d6bc3f13f02ee0137d9a"
server_key_iv: "dab3ef76d97e5dd5604202e3b258545b"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.896696 11649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "7acb39b0703644b3ace95054d6e98e71"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "11da3ddf26c9d6bc3f13f02ee0137d9a"
server_key_iv: "dab3ef76d97e5dd5604202e3b258545b"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.898198 11649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:08.899224 11666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.899605 11649 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:08.899724 11649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "7acb39b0703644b3ace95054d6e98e71"
format_stamp: "Formatted at 2026-08-07 00:35:08 on dist-test-slave-csg5"
server_key: "11da3ddf26c9d6bc3f13f02ee0137d9a"
server_key_iv: "dab3ef76d97e5dd5604202e3b258545b"
server_key_version: "encryptionkey@0"
I20260807 00:35:08.899827 11649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:08.924757 11649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:08.927290 11649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:08.927517 11649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:08.927779 11649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:08.928110 11649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:08.928169 11649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.928236 11649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:08.928262 11649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:08.934849 11649 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:37151
I20260807 00:35:08.934882 11788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:37151 every 8 connection(s)
I20260807 00:35:08.935259 11649 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
Aug 07 00:35:08 dist-test-slave-csg5 krb5kdc[11386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062908, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:08.943347 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11649
I20260807 00:35:08.943468 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:08.943724 8176 external_mini_cluster.cc:1428] Setting key 3bf017f50ce3fc961539da04ca3957b0
I20260807 00:35:08.945946 11476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:08.936019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:54871 (local address 127.7.252.62:40395)
0807 00:35:08.936100 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:08.936102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:08.936400 (+ 298us) server_negotiation.cc:407] Connection header received
0807 00:35:08.936901 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:08.936903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:08.936914 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:08.936971 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:08.938004 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.938533 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.939584 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.939803 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.939911 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:08.942303 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:08.942304 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:08.942304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:08.942312 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:08.944264 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:08.944789 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:08.944790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:08.944791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:08.944855 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:08.945156 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:08.945157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:08.945157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:08.945305 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:08.945383 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:08.945689 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 00:35:08.945795 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:35:08.945982 11791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:08.936000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:40395 (local address 127.7.252.2:54871)
0807 00:35:08.936218 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:08.936266 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:08.936781 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:08.937053 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:08.937056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:08.937697 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:08.937902 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:08.937908 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.938620 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.938621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:08.939500 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:08.939502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:08.939989 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:08.939990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:08.940132 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:08.940671 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:08.940680 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:08.942114 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:08.944354 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:08.944363 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:08.944365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:08.944689 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:08.944946 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:08.944947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:08.944947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:08.945067 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:08.945398 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:08.945405 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:08.945546 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 00:35:08.945649 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 00:35:08.945795 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":103,"threads_started":1}
I20260807 00:35:08.946889 11789 heartbeater.cc:347] Connected to a master server at 127.7.252.62:40395
I20260807 00:35:08.946987 11789 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:08.947212 11789 heartbeater.cc:511] Master 127.7.252.62:40395 requested a full tablet report, sending...
I20260807 00:35:08.947676 11434 ts_manager.cc:194] Registered new tserver with Master: 7acb39b0703644b3ace95054d6e98e71 (127.7.252.2:37151)
I20260807 00:35:08.948058 11434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:54871
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:08.975042 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:40395
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:41421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:09.062397 11794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:09.062649 11794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:09.062712 11794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:09.064087 11794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:09.064180 11794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:09.064229 11794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:09.065806 11794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:41421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:09.066097 11794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:09.066349 11794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:09.071698 11800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:09.071688 11803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:09.071688 11801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:09.072497 11794 server_base.cc:1034] running on GCE node
I20260807 00:35:09.072762 11794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:09.072989 11794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:09.074144 11794 hybrid_clock.cc:648] HybridClock initialized: now 1786062909074120 us; error 47 us; skew 500 ppm
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062909, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:09.077216 11794 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:09.077734 11794 webserver.cc:460] Webserver started at http://127.7.252.3:38509/ using document root <none> and password file <none>
I20260807 00:35:09.078006 11794 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:09.078058 11794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:09.078205 11794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:09.079507 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "40ea53df28dc4beb9ce246aa759d126c"
format_stamp: "Formatted at 2026-08-07 00:35:09 on dist-test-slave-csg5"
server_key: "51cc1ec4d07278a05ef08e1c44c33e14"
server_key_iv: "c5a637bb83f1f579e2c8381de930e175"
server_key_version: "encryptionkey@0"
I20260807 00:35:09.079931 11794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "40ea53df28dc4beb9ce246aa759d126c"
format_stamp: "Formatted at 2026-08-07 00:35:09 on dist-test-slave-csg5"
server_key: "51cc1ec4d07278a05ef08e1c44c33e14"
server_key_iv: "c5a637bb83f1f579e2c8381de930e175"
server_key_version: "encryptionkey@0"
I20260807 00:35:09.081606 11794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:35:09.082567 11811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:09.082787 11794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:09.082940 11794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "40ea53df28dc4beb9ce246aa759d126c"
format_stamp: "Formatted at 2026-08-07 00:35:09 on dist-test-slave-csg5"
server_key: "51cc1ec4d07278a05ef08e1c44c33e14"
server_key_iv: "c5a637bb83f1f579e2c8381de930e175"
server_key_version: "encryptionkey@0"
I20260807 00:35:09.083035 11794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:09.091094 11794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:09.093690 11794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:09.093909 11794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:09.094190 11794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:09.094542 11794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:09.094604 11794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:09.094683 11794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:09.094714 11794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:09.101500 11794 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:39345
I20260807 00:35:09.101558 11930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:39345 every 8 connection(s)
I20260807 00:35:09.101936 11794 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062909, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:09.111788 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11794
I20260807 00:35:09.111901 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:09.112105 8176 external_mini_cluster.cc:1428] Setting key 7be634eefa58528a74daa4366ee9143e
I20260807 00:35:09.113209 11476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:09.102874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:40793 (local address 127.7.252.62:40395)
0807 00:35:09.102934 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:09.102937 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:09.103238 (+ 301us) server_negotiation.cc:407] Connection header received
0807 00:35:09.103830 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:09.103831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:09.103843 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:09.103903 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:09.105062 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:09.105643 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:09.106799 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:09.107005 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:09.107065 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:09.109510 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:09.109512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:09.109512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:09.109520 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:09.111285 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:09.112026 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:09.112028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:09.112028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:09.112107 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:09.112430 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:09.112432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:09.112432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:09.112589 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:09.112678 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:09.113016 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 00:35:09.113108 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:35:09.113452 11934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:09.102908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:40395 (local address 127.7.252.3:40793)
0807 00:35:09.103089 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:09.103132 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:09.103708 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:09.104000 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:09.104005 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:09.104725 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:09.104943 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:09.104948 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:09.105742 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:09.105743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:09.106643 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:09.106646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:09.107087 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:09.107088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:09.107205 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:09.107726 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:09.107736 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:09.109388 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:09.111385 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:09.111393 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:09.111395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:09.111803 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:09.112199 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:09.112200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:09.112201 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:09.112349 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:09.112650 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:09.112658 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:09.112875 (+ 217us) client_negotiation.cc:769] Sending connection context
0807 00:35:09.113002 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 00:35:09.113197 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
I20260807 00:35:09.113927 11931 heartbeater.cc:347] Connected to a master server at 127.7.252.62:40395
I20260807 00:35:09.114049 11931 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:09.114245 11931 heartbeater.cc:511] Master 127.7.252.62:40395 requested a full tablet report, sending...
I20260807 00:35:09.114724 11434 ts_manager.cc:194] Registered new tserver with Master: 40ea53df28dc4beb9ce246aa759d126c (127.7.252.3:39345)
I20260807 00:35:09.115095 11434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:40793
I20260807 00:35:09.124797 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062909, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062909, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:09.153692 11476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:09.145015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60698 (local address 127.7.252.62:40395)
0807 00:35:09.145089 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:09.145091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:09.145117 (+ 26us) server_negotiation.cc:407] Connection header received
0807 00:35:09.145217 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:09.145218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:09.145230 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:09.145301 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:09.145977 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:09.146512 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:09.147463 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:09.147649 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:09.147708 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:09.150380 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:09.150381 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:09.150381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:09.150389 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:09.151932 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:09.152564 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:09.152565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:09.152566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:09.152632 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:09.152911 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:09.152912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:09.152913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:09.153100 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:09.153202 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:09.153444 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 00:35:09.153533 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 00:35:09.154017 11434 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60698
I20260807 00:35:09.154605 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11501
I20260807 00:35:09.160393 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11649
I20260807 00:35:09.167168 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11794
I20260807 00:35:09.174017 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11400
2026-08-07T00:35:09Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2046 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11944](info): set up 2 sockets
Aug 07 00:35:09 dist-test-slave-csg5 krb5kdc[11944](info): commencing operation
krb5kdc: starting...
W20260807 00:35:10.339241 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:10.479130 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35091
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:35091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:10.565690 11958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:10.565958 11958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:10.565997 11958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:10.567332 11958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:10.567404 11958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:10.567433 11958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:10.567456 11958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:10.567487 11958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:10.569164 11958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:35091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:10.569468 11958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:10.569728 11958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:10.575311 11967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:10.575445 11958 server_base.cc:1034] running on GCE node
W20260807 00:35:10.575388 11964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:10.575387 11965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:10.575881 11958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:10.576222 11958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:10.577432 11958 hybrid_clock.cc:648] HybridClock initialized: now 1786062910577412 us; error 51 us; skew 500 ppm
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:10.580358 11958 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:10.580922 11958 webserver.cc:460] Webserver started at http://127.7.252.62:40927/ using document root <none> and password file <none>
I20260807 00:35:10.581210 11958 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:10.581281 11958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:10.581453 11958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:10.582778 11958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "7f9ffc129cb5b1ea1b7e0575018b2edf"
server_key_iv: "8d5a2d27812f450bc57dacd66edcc1a6"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.583194 11958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "7f9ffc129cb5b1ea1b7e0575018b2edf"
server_key_iv: "8d5a2d27812f450bc57dacd66edcc1a6"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.584761 11958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:10.585686 11975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.585888 11958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:10.586001 11958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "7f9ffc129cb5b1ea1b7e0575018b2edf"
server_key_iv: "8d5a2d27812f450bc57dacd66edcc1a6"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.586082 11958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:10.594642 11958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:10.597321 11958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:10.597506 11958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:10.602200 11958 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:35091
I20260807 00:35:10.602244 12034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:35091 every 8 connection(s)
I20260807 00:35:10.602903 11958 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:10.603648 12035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:10.605695 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 11958
I20260807 00:35:10.605826 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:10.606005 8176 external_mini_cluster.cc:1428] Setting key 55b5d638b69f9bc031542f5f2ba104f5
I20260807 00:35:10.606130 12035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b: Bootstrap starting.
I20260807 00:35:10.606983 12035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:10.607338 12035 log.cc:824] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:10.608389 12035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b: No bootstrap required, opened a new log
I20260807 00:35:10.610945 12035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35091 } }
I20260807 00:35:10.611109 12035 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:10.611132 12035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99aa79d1a7cc4bd9ac798874bdd07b8b, State: Initialized, Role: FOLLOWER
I20260807 00:35:10.611291 12035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35091 } }
I20260807 00:35:10.611375 12035 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:10.611411 12035 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:10.611466 12035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:10.612385 12035 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35091 } }
I20260807 00:35:10.612512 12035 leader_election.cc:302] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99aa79d1a7cc4bd9ac798874bdd07b8b; no voters:
I20260807 00:35:10.612710 12035 leader_election.cc:288] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:10.612812 12040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:10.613016 12035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:10.613000 12040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [term 1 LEADER]: Becoming Leader. State: Replica: 99aa79d1a7cc4bd9ac798874bdd07b8b, State: Running, Role: LEADER
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:10.614260 12040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35091 } }
W20260807 00:35:10.615772 12055 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:35:10.615832 12055 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:35:10.615075 12042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99aa79d1a7cc4bd9ac798874bdd07b8b. Latest consensus state: current_term: 1 leader_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35091 } } }
I20260807 00:35:10.615926 12042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:10.615284 12041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99aa79d1a7cc4bd9ac798874bdd07b8b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35091 } } }
I20260807 00:35:10.616104 12041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:10.617255 12058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:10.617436 12058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:10.619222 12058 catalog_manager.cc:1347] Generated new cluster ID: e714173037a1411393b4c6147e3365ba
I20260807 00:35:10.619292 12058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:10.619532 12038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:10.606644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38074 (local address 127.7.252.62:35091)
0807 00:35:10.606894 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:10.606903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:10.606941 (+ 38us) server_negotiation.cc:407] Connection header received
0807 00:35:10.607619 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:10.607630 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:10.607700 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:10.607869 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:10.608827 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.609689 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.610933 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.611646 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.611735 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:10.614863 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:10.614869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:10.614869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:10.614882 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:10.617113 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:10.617767 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:10.617771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:10.617772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:10.617889 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:10.618156 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:10.618157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:10.618158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:10.618534 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:10.618756 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:10.618981 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 00:35:10.619143 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260807 00:35:10.626529 12058 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:10.627182 12058 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:10.636329 12058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99aa79d1a7cc4bd9ac798874bdd07b8b: Generated new TSK 0
I20260807 00:35:10.636615 12058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:10.671339 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35091
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:10.775460 12062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:10.775684 12062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:10.775710 12062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:10.776942 12062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:10.776990 12062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:10.777019 12062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:10.778779 12062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:10.779037 12062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:10.779284 12062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:10.784580 12072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:10.784628 12069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:10.784834 12062 server_base.cc:1034] running on GCE node
W20260807 00:35:10.784894 12068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:10.785279 12062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:10.785557 12062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:10.786778 12062 hybrid_clock.cc:648] HybridClock initialized: now 1786062910786733 us; error 65 us; skew 500 ppm
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:10.789876 12062 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:10.790393 12062 webserver.cc:460] Webserver started at http://127.7.252.1:36219/ using document root <none> and password file <none>
I20260807 00:35:10.790635 12062 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:10.790757 12062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:10.790956 12062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:10.792068 12062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "587a89f959c444e5a4c59319d5ae848b"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "10a145ed4fd78ffdf90d43babcb16717"
server_key_iv: "a731435dd6df93719aca059bfb2dd019"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.792455 12062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "587a89f959c444e5a4c59319d5ae848b"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "10a145ed4fd78ffdf90d43babcb16717"
server_key_iv: "a731435dd6df93719aca059bfb2dd019"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.793919 12062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:10.795118 12079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.795487 12062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:10.795609 12062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "587a89f959c444e5a4c59319d5ae848b"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "10a145ed4fd78ffdf90d43babcb16717"
server_key_iv: "a731435dd6df93719aca059bfb2dd019"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.795682 12062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:10.806872 12062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:10.809197 12062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:10.809397 12062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:10.809675 12062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:10.810025 12062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:10.810083 12062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.810118 12062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:10.810161 12062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.816520 12062 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:38671
I20260807 00:35:10.816568 12200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:38671 every 8 connection(s)
I20260807 00:35:10.816905 12062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:10.818863 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12062
I20260807 00:35:10.819001 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:10.819199 8176 external_mini_cluster.cc:1428] Setting key 3a8b6fc765fda5d7d3276990969b4d3d
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:10.828888 12038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:10.817749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:54457 (local address 127.7.252.62:35091)
0807 00:35:10.817911 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:10.817914 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:10.817949 (+ 35us) server_negotiation.cc:407] Connection header received
0807 00:35:10.819338 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:10.819339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:10.819353 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:10.819439 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:10.820377 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.820895 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.822266 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.822485 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.822575 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:10.825195 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:10.825198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:10.825198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:10.825209 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:10.827066 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:10.827565 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:10.827566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:10.827567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:10.827641 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:10.827950 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:10.827951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:10.827952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:10.828119 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:10.828230 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:10.828652 (+ 422us) server_negotiation.cc:299] Negotiation successful
0807 00:35:10.828773 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260807 00:35:10.828995 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:10.817633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35091 (local address 127.7.252.1:54457)
0807 00:35:10.817831 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:10.817876 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:10.819097 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:10.819570 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:10.819575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:10.819966 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:10.820276 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:10.820282 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.820995 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.820996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:10.822158 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:10.822161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.822589 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.822590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:10.822772 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:10.823294 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:10.823305 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:10.825077 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:10.827179 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:10.827188 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:10.827190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:10.827473 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:10.827742 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:10.827743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:10.827743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:10.827874 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:10.828326 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:10.828333 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:10.828498 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 00:35:10.828603 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 00:35:10.828767 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:35:10.829670 12201 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35091
I20260807 00:35:10.829831 12201 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:10.830081 12201 heartbeater.cc:511] Master 127.7.252.62:35091 requested a full tablet report, sending...
I20260807 00:35:10.830798 11996 ts_manager.cc:194] Registered new tserver with Master: 587a89f959c444e5a4c59319d5ae848b (127.7.252.1:38671)
I20260807 00:35:10.831593 11996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:54457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:10.855093 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35091
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:10.945084 12206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:10.945363 12206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:10.945393 12206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:10.946729 12206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:10.946782 12206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:10.946813 12206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:10.948544 12206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:10.948786 12206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:10.948998 12206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:10.954871 12211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:10.954890 12212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:10.955193 12206 server_base.cc:1034] running on GCE node
W20260807 00:35:10.954890 12214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:10.955607 12206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:10.955847 12206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:10.956998 12206 hybrid_clock.cc:648] HybridClock initialized: now 1786062910956983 us; error 33 us; skew 500 ppm
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:10.959987 12206 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:10.960493 12206 webserver.cc:460] Webserver started at http://127.7.252.2:34887/ using document root <none> and password file <none>
I20260807 00:35:10.960739 12206 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:10.960808 12206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:10.960952 12206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:10.962131 12206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "7d2798f021ac4f71b647b951498f06dc"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "6bb53f150a672d21b9e169f421528790"
server_key_iv: "5dbdcf7012f959dc8eee73c9c9b940ce"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.962718 12206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "7d2798f021ac4f71b647b951498f06dc"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "6bb53f150a672d21b9e169f421528790"
server_key_iv: "5dbdcf7012f959dc8eee73c9c9b940ce"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.964222 12206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:10.965193 12221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.965521 12206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:10.965659 12206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "7d2798f021ac4f71b647b951498f06dc"
format_stamp: "Formatted at 2026-08-07 00:35:10 on dist-test-slave-csg5"
server_key: "6bb53f150a672d21b9e169f421528790"
server_key_iv: "5dbdcf7012f959dc8eee73c9c9b940ce"
server_key_version: "encryptionkey@0"
I20260807 00:35:10.965728 12206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:10.980263 12206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:10.983110 12206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:10.983381 12206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:10.983671 12206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:10.984021 12206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:10.984082 12206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.984128 12206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:10.984162 12206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:10.990911 12206 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:34951
I20260807 00:35:10.990964 12345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:34951 every 8 connection(s)
I20260807 00:35:10.991328 12206 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:10.992048 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12206
I20260807 00:35:10.992182 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:10.992421 8176 external_mini_cluster.cc:1428] Setting key 419f153f204d070b93cb43de0b78adba
Aug 07 00:35:10 dist-test-slave-csg5 krb5kdc[11944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062910, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:35:11.004593 12038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:10.992151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:55059 (local address 127.7.252.62:35091)
0807 00:35:10.992206 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:10.992208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:10.992523 (+ 315us) server_negotiation.cc:407] Connection header received
0807 00:35:10.993934 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:10.993935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:10.993952 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:10.994006 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:10.995111 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.995803 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.997536 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.997761 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.997826 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:11.001183 (+ 3357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:11.001185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:11.001185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:11.001193 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:11.002906 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.003477 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.003478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.003479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.003550 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.003885 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.003885 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.003885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.003997 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:11.004051 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:11.004426 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 00:35:11.004499 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:35:11.004922 12348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:10.992153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35091 (local address 127.7.252.2:55059)
0807 00:35:10.992344 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:10.992404 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:10.993813 (+ 1409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:10.994092 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:10.994097 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:10.994608 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:10.994987 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:10.994995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.995933 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.995934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:10.997419 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:10.997423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:10.997860 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:10.997861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:10.998048 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:10.998811 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:10.998825 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:11.001046 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:11.003000 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:11.003011 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:11.003015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:11.003373 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:11.003621 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:11.003622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:11.003622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:11.003808 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:11.004094 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:11.004101 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:11.004265 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 00:35:11.004382 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 00:35:11.004580 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260807 00:35:11.005793 12346 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35091
I20260807 00:35:11.005934 12346 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:11.006132 12346 heartbeater.cc:511] Master 127.7.252.62:35091 requested a full tablet report, sending...
I20260807 00:35:11.006738 11996 ts_manager.cc:194] Registered new tserver with Master: 7d2798f021ac4f71b647b951498f06dc (127.7.252.2:34951)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
I20260807 00:35:11.007308 11996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:55059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:11.027513 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35091
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:11.117331 12351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:11.117540 12351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:11.117565 12351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:11.118830 12351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:11.118878 12351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:11.118906 12351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:11.120483 12351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:11.120747 12351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:11.121021 12351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:11.127249 12356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:11.127247 12357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:11.127372 12359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:11.127277 12351 server_base.cc:1034] running on GCE node
I20260807 00:35:11.127728 12351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:11.128010 12351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:11.129251 12351 hybrid_clock.cc:648] HybridClock initialized: now 1786062911129239 us; error 56 us; skew 500 ppm
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[11944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062911, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:11.132683 12351 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:11.133209 12351 webserver.cc:460] Webserver started at http://127.7.252.3:36791/ using document root <none> and password file <none>
I20260807 00:35:11.133459 12351 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:11.133533 12351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:11.133713 12351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:11.135054 12351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "9ad94ddc4b92422faf2adc9fc3645a63"
format_stamp: "Formatted at 2026-08-07 00:35:11 on dist-test-slave-csg5"
server_key: "c7e4993ba92f2bd7eeddf96fe73a1503"
server_key_iv: "6c8b2e3f33a768c717a8b3a096042f0b"
server_key_version: "encryptionkey@0"
I20260807 00:35:11.135448 12351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "9ad94ddc4b92422faf2adc9fc3645a63"
format_stamp: "Formatted at 2026-08-07 00:35:11 on dist-test-slave-csg5"
server_key: "c7e4993ba92f2bd7eeddf96fe73a1503"
server_key_iv: "6c8b2e3f33a768c717a8b3a096042f0b"
server_key_version: "encryptionkey@0"
I20260807 00:35:11.137005 12351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:11.138070 12367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:11.138438 12351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:11.138572 12351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "9ad94ddc4b92422faf2adc9fc3645a63"
format_stamp: "Formatted at 2026-08-07 00:35:11 on dist-test-slave-csg5"
server_key: "c7e4993ba92f2bd7eeddf96fe73a1503"
server_key_iv: "6c8b2e3f33a768c717a8b3a096042f0b"
server_key_version: "encryptionkey@0"
I20260807 00:35:11.138659 12351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:11.147253 12351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:11.150086 12351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:11.150290 12351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:11.150583 12351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:11.151005 12351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:11.151067 12351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:11.151110 12351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:11.151144 12351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:11.157073 12351 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:39409
I20260807 00:35:11.157150 12494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:39409 every 8 connection(s)
I20260807 00:35:11.157485 12351 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:11.164489 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12351
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[11944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062911, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:11.164638 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:11.164858 8176 external_mini_cluster.cc:1428] Setting key edceb311830501fdc4f7d345cd103f29
I20260807 00:35:11.169051 12038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:11.158355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:48075 (local address 127.7.252.62:35091)
0807 00:35:11.158445 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:11.158448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:11.158579 (+ 131us) server_negotiation.cc:407] Connection header received
0807 00:35:11.159708 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:11.159710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:11.159724 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:11.159781 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:11.160453 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.161104 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.162334 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.162534 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.162598 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:11.165204 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:11.165206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:11.165207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:11.165217 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:11.167130 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.167637 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.167639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.167639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.167723 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.168117 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.168119 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.168119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.168300 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:11.168374 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:11.168772 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 00:35:11.168928 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 00:35:11.169324 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:11.158250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35091 (local address 127.7.252.3:48075)
0807 00:35:11.158435 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:11.158480 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:11.159586 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:11.159843 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:11.159847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:11.160134 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:11.160343 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:11.160348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.161297 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.161298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:11.162230 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:11.162234 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.162725 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.162726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:11.162840 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:11.163470 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:11.163479 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:11.165064 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:11.167235 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:11.167243 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:11.167246 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:11.167535 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:11.167816 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:11.167817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:11.167818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:11.167943 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:11.168413 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:11.168419 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:11.168556 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 00:35:11.168651 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 00:35:11.168800 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260807 00:35:11.169901 12495 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35091
I20260807 00:35:11.169989 12495 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:11.170183 12495 heartbeater.cc:511] Master 127.7.252.62:35091 requested a full tablet report, sending...
I20260807 00:35:11.170593 11996 ts_manager.cc:194] Registered new tserver with Master: 9ad94ddc4b92422faf2adc9fc3645a63 (127.7.252.3:39409)
I20260807 00:35:11.171037 11996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:48075
I20260807 00:35:11.177486 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[11944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[11944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:35:11.206167 12502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:11.196710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.7.252.1:38671)
0807 00:35:11.196906 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:11.196912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:11.196933 (+ 21us) server_negotiation.cc:407] Connection header received
0807 00:35:11.196961 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:11.196963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:11.196976 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:11.197048 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:11.197736 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.198515 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.199774 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.200099 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.200163 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:11.202776 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:11.202787 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:11.202787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:11.202801 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:11.204564 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.204995 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.204999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.204999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.205077 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.205532 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.205533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.205533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.205708 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:11.205848 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:11.205952 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 00:35:11.206027 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":120,"threads_started":1}
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[11944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:11.215818 12038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:11.207786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.7.252.62:35091)
0807 00:35:11.207846 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:11.207848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:11.207858 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:11.207922 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:11.207923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:11.207933 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:11.207971 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:11.208469 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.208985 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.209714 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:11.209931 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:11.209989 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:11.212620 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:11.212622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:11.212622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:11.212630 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:11.214349 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.214805 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.214806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.214806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.214879 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:11.215129 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:11.215130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:11.215131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:11.215374 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:11.215484 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:11.215626 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 00:35:11.215710 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 00:35:11.216125 11996 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38076
I20260807 00:35:11.216536 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12062
I20260807 00:35:11.227130 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12206
I20260807 00:35:11.234233 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12351
I20260807 00:35:11.241175 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 11958
2026-08-07T00:35:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2067 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[12507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[12507](info): set up 2 sockets
Aug 07 00:35:11 dist-test-slave-csg5 krb5kdc[12507](info): commencing operation
krb5kdc: starting...
W20260807 00:35:12.320197 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:12.461971 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41295
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:35463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:12.548899 12520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:12.549167 12520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:12.549211 12520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:12.550473 12520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:12.550546 12520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:12.550568 12520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:12.550590 12520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:12.550621 12520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:12.552316 12520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:12.552618 12520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:12.552873 12520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:12.558354 12520 server_base.cc:1034] running on GCE node
W20260807 00:35:12.558518 12525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:12.558568 12529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:12.558602 12526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:12.559067 12520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:12.559459 12520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:12.560671 12520 hybrid_clock.cc:648] HybridClock initialized: now 1786062912560631 us; error 50 us; skew 500 ppm
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:12.567891 12520 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:12.568377 12520 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:12.568468 12520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:12.568650 12520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:12.569947 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "975df86ee1eb4998a3793e9d10f91fc8"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "250e305f42c392ab09cd68a9a7cff869"
server_key_iv: "e24c1eb02419b779a4bc8f370d0c8763"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.570422 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "975df86ee1eb4998a3793e9d10f91fc8"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "250e305f42c392ab09cd68a9a7cff869"
server_key_iv: "e24c1eb02419b779a4bc8f370d0c8763"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.572131 12520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260807 00:35:12.573268 12535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.573504 12520 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:12.573626 12520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "975df86ee1eb4998a3793e9d10f91fc8"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "250e305f42c392ab09cd68a9a7cff869"
server_key_iv: "e24c1eb02419b779a4bc8f370d0c8763"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.573711 12520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:12.594612 12520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:12.597100 12520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:12.597282 12520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:12.601557 12520 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41295
I20260807 00:35:12.601608 12591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41295 every 8 connection(s)
I20260807 00:35:12.601959 12520 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:12.603300 12593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:12.605782 12593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: Bootstrap starting.
I20260807 00:35:12.606393 12593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:12.606766 12593 log.cc:824] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:12.607630 12593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: No bootstrap required, opened a new log
I20260807 00:35:12.608381 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12520
I20260807 00:35:12.608494 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:12.608695 8176 external_mini_cluster.cc:1428] Setting key 0f241a7568e9b88123e742838de5d243
I20260807 00:35:12.610432 12593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "975df86ee1eb4998a3793e9d10f91fc8" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41295 } }
I20260807 00:35:12.610623 12593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:12.610737 12593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975df86ee1eb4998a3793e9d10f91fc8, State: Initialized, Role: FOLLOWER
I20260807 00:35:12.610948 12593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "975df86ee1eb4998a3793e9d10f91fc8" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41295 } }
I20260807 00:35:12.611059 12593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:12.611097 12593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:12.611159 12593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:12.611970 12593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "975df86ee1eb4998a3793e9d10f91fc8" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41295 } }
I20260807 00:35:12.612118 12593 leader_election.cc:302] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 975df86ee1eb4998a3793e9d10f91fc8; no voters:
I20260807 00:35:12.612339 12593 leader_election.cc:288] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:12.612377 12598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:12.612496 12598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [term 1 LEADER]: Becoming Leader. State: Replica: 975df86ee1eb4998a3793e9d10f91fc8, State: Running, Role: LEADER
I20260807 00:35:12.612654 12593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:12.612670 12598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "975df86ee1eb4998a3793e9d10f91fc8" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41295 } }
I20260807 00:35:12.613433 12599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "975df86ee1eb4998a3793e9d10f91fc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "975df86ee1eb4998a3793e9d10f91fc8" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41295 } } }
I20260807 00:35:12.613714 12599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:12.613940 12600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 975df86ee1eb4998a3793e9d10f91fc8. Latest consensus state: current_term: 1 leader_uuid: "975df86ee1eb4998a3793e9d10f91fc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "975df86ee1eb4998a3793e9d10f91fc8" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41295 } } }
I20260807 00:35:12.614027 12600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8 [sys.catalog]: This master's current role is: LEADER
W20260807 00:35:12.614771 12616 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:35:12.614867 12616 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:35:12.614938 12609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:12.615129 12609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:12.616581 12609 catalog_manager.cc:1347] Generated new cluster ID: 1719101e4f18456b801cb21ed5363f2e
I20260807 00:35:12.616631 12609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:12.622047 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:12.609346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41136 (local address 127.7.252.62:41295)
0807 00:35:12.609549 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:12.609558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:12.609586 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:35:12.610419 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:12.610427 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:12.610495 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:12.610641 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:12.611637 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.612858 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.613937 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.614586 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.614746 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:12.617900 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:12.617904 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:12.617904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:12.617917 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:12.620021 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:12.620504 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:12.620507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:12.620508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:12.620635 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:12.620886 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:12.620887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:12.620887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:12.621198 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:12.621363 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:12.621568 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 00:35:12.621715 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":96,"threads_started":1}
I20260807 00:35:12.631762 12609 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:12.632360 12609 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:12.644930 12609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: Generated new TSK 0
I20260807 00:35:12.645169 12609 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:12.683660 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41295
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:35463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:12.774554 12623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:12.774858 12623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:12.774885 12623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:12.776126 12623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:12.776175 12623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:12.776201 12623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:12.777941 12623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:12.778200 12623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:12.778450 12623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:12.784008 12629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:12.784017 12630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:12.784040 12623 server_base.cc:1034] running on GCE node
W20260807 00:35:12.784021 12632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:12.784650 12623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:12.784945 12623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:12.786139 12623 hybrid_clock.cc:648] HybridClock initialized: now 1786062912786113 us; error 43 us; skew 500 ppm
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:12.789181 12623 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:12.789681 12623 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:12.789795 12623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:12.789965 12623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:12.791245 12623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "f155cbc833994fa1bfa5e33c58635101"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "794a4e5489edb5d248c72c54b74f5482"
server_key_iv: "81f72526438d1ead0879008d84a3b3b9"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.791643 12623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "f155cbc833994fa1bfa5e33c58635101"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "794a4e5489edb5d248c72c54b74f5482"
server_key_iv: "81f72526438d1ead0879008d84a3b3b9"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.793146 12623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:35:12.794138 12638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.794518 12623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:12.794643 12623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "f155cbc833994fa1bfa5e33c58635101"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "794a4e5489edb5d248c72c54b74f5482"
server_key_iv: "81f72526438d1ead0879008d84a3b3b9"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.794764 12623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:12.819646 12623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:12.822206 12623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:12.822404 12623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:12.822690 12623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:12.823045 12623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:12.823101 12623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.823146 12623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:12.823179 12623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.829496 12623 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:44015
I20260807 00:35:12.829546 12756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:44015 every 8 connection(s)
I20260807 00:35:12.829833 12623 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:12.830340 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12623
I20260807 00:35:12.830470 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:12.830734 8176 external_mini_cluster.cc:1428] Setting key 5360647ea3c79ff862ed067e9d657ea8
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:35:12.841953 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:12.830712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:45893 (local address 127.7.252.62:41295)
0807 00:35:12.830776 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:12.830778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:12.831129 (+ 351us) server_negotiation.cc:407] Connection header received
0807 00:35:12.831815 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:12.831816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:12.831833 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:12.831907 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:12.833002 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.833697 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.835317 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.835535 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.835599 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:12.838344 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:12.838346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:12.838347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:12.838360 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:12.840212 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:12.840688 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:12.840690 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:12.840690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:12.840770 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:12.841093 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:12.841094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:12.841095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:12.841234 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:12.841299 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:12.841796 (+ 497us) server_negotiation.cc:299] Negotiation successful
0807 00:35:12.841878 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 00:35:12.842275 12759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:12.830742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41295 (local address 127.7.252.1:45893)
0807 00:35:12.830982 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:12.831036 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:12.831704 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:12.831962 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:12.831965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:12.832240 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:12.832888 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:12.832894 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.833817 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.833818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:12.835189 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:12.835192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.835630 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.835631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:12.835814 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:12.836499 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:12.836511 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:12.838234 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:12.840353 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:12.840361 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:12.840363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:12.840600 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:12.840874 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:12.840876 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:12.840877 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:12.841010 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:12.841487 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:12.841494 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:12.841627 (+ 133us) client_negotiation.cc:769] Sending connection context
0807 00:35:12.841736 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 00:35:12.841873 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":96,"threads_started":1}
I20260807 00:35:12.843127 12757 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41295
I20260807 00:35:12.843357 12757 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:12.843572 12757 heartbeater.cc:511] Master 127.7.252.62:41295 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
I20260807 00:35:12.844302 12554 ts_manager.cc:194] Registered new tserver with Master: f155cbc833994fa1bfa5e33c58635101 (127.7.252.1:44015)
I20260807 00:35:12.845232 12554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:45893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:12.863344 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41295
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:35463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:12.946940 12763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:12.947192 12763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:12.947233 12763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:12.948470 12763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:12.948546 12763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:12.948590 12763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:12.950256 12763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:12.950567 12763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:12.950850 12763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:12.956480 12770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:12.956456 12771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:12.956498 12763 server_base.cc:1034] running on GCE node
W20260807 00:35:12.956458 12773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:12.956882 12763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:12.957144 12763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:12.958338 12763 hybrid_clock.cc:648] HybridClock initialized: now 1786062912958296 us; error 81 us; skew 500 ppm
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:12.961462 12763 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:12.961853 12763 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:12.961933 12763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:12.962096 12763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:12.963284 12763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "6a76b30898c24604b3d22c1588aa4bab"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "9545d4709202c68b02dc80e52b0131da"
server_key_iv: "06d91e1ad5ab0b243aa0e309e4cadf67"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.963666 12763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "6a76b30898c24604b3d22c1588aa4bab"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "9545d4709202c68b02dc80e52b0131da"
server_key_iv: "06d91e1ad5ab0b243aa0e309e4cadf67"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.965161 12763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:12.966084 12779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.966384 12763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:12.966501 12763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "6a76b30898c24604b3d22c1588aa4bab"
format_stamp: "Formatted at 2026-08-07 00:35:12 on dist-test-slave-csg5"
server_key: "9545d4709202c68b02dc80e52b0131da"
server_key_iv: "06d91e1ad5ab0b243aa0e309e4cadf67"
server_key_version: "encryptionkey@0"
I20260807 00:35:12.966584 12763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:12.979980 12763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:12.982472 12763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:12.982695 12763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:12.982981 12763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:12.983325 12763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:12.983381 12763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.983417 12763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:12.983445 12763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:12.989512 12763 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:36751
I20260807 00:35:12.989610 12899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:36751 every 8 connection(s)
I20260807 00:35:12.989897 12763 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
Aug 07 00:35:12 dist-test-slave-csg5 krb5kdc[12507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062912, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:12.999647 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12763
I20260807 00:35:12.999788 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:12.999985 8176 external_mini_cluster.cc:1428] Setting key bf6ffe5ab828eca128f6aacf012b1bf0
I20260807 00:35:13.000036 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:12.990717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:57419 (local address 127.7.252.62:41295)
0807 00:35:12.990793 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:12.990795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:12.991019 (+ 224us) server_negotiation.cc:407] Connection header received
0807 00:35:12.991641 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:12.991643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:12.991655 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:12.991713 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:12.992673 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.993200 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.994194 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.994412 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.994487 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:12.996860 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:12.996862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:12.996862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:12.996869 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:12.998500 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:12.998988 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:12.998990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:12.998990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:12.999051 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:12.999343 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:12.999344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:12.999344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:12.999469 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:12.999546 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:12.999851 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 00:35:12.999946 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:35:13.000262 12902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:12.990717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41295 (local address 127.7.252.2:57419)
0807 00:35:12.990895 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:12.990931 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:12.991526 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:12.991780 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:12.991784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:12.992060 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:12.992570 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:12.992575 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.993298 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.993299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:12.994102 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:12.994104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:12.994507 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:12.994508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:12.994639 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:12.995210 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:12.995218 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:12.996689 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:12.998592 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:12.998601 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:12.998603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:12.998908 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:12.999129 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:12.999129 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:12.999130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:12.999249 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:12.999536 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:12.999543 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:12.999691 (+ 148us) client_negotiation.cc:769] Sending connection context
0807 00:35:12.999810 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 00:35:12.999974 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260807 00:35:13.000715 12900 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41295
I20260807 00:35:13.000846 12900 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:13.001026 12900 heartbeater.cc:511] Master 127.7.252.62:41295 requested a full tablet report, sending...
I20260807 00:35:13.001456 12554 ts_manager.cc:194] Registered new tserver with Master: 6a76b30898c24604b3d22c1588aa4bab (127.7.252.2:36751)
I20260807 00:35:13.001956 12554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:57419
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:13.030776 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41295
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:35463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:13.115540 12905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:13.115806 12905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:13.115857 12905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:13.117098 12905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:13.117173 12905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:13.117223 12905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:13.118947 12905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:13.119277 12905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:13.119519 12905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:13.124747 12910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.124833 12905 server_base.cc:1034] running on GCE node
W20260807 00:35:13.124747 12911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.124792 12913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.125308 12905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:13.125586 12905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:13.126744 12905 hybrid_clock.cc:648] HybridClock initialized: now 1786062913126717 us; error 42 us; skew 500 ppm
Aug 07 00:35:13 dist-test-slave-csg5 krb5kdc[12507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062913, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:13.129424 12905 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:13.129863 12905 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:13.129941 12905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:13.130097 12905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:13.131271 12905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "ab4d5a0f0abbdae5c76634042eca6ed6"
server_key_iv: "827500adeabe1f949893c5281e40fba4"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.131647 12905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "ab4d5a0f0abbdae5c76634042eca6ed6"
server_key_iv: "827500adeabe1f949893c5281e40fba4"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.133071 12905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:13.134066 12920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.134284 12905 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:13.134409 12905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "ab4d5a0f0abbdae5c76634042eca6ed6"
server_key_iv: "827500adeabe1f949893c5281e40fba4"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.134536 12905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:13.157845 12905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:13.160368 12905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:13.160554 12905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:13.160816 12905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:13.161151 12905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:13.161207 12905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.161254 12905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:13.161286 12905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.167600 12905 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:33657
I20260807 00:35:13.167647 13038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:33657 every 8 connection(s)
I20260807 00:35:13.167936 12905 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:35:13 dist-test-slave-csg5 krb5kdc[12507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062913, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:13.177030 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 12905
I20260807 00:35:13.177139 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:13.177390 8176 external_mini_cluster.cc:1428] Setting key 816770252091f0cfed4c1e2e04e044fc
I20260807 00:35:13.178234 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.168672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:52879 (local address 127.7.252.62:41295)
0807 00:35:13.168746 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.168748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.168955 (+ 207us) server_negotiation.cc:407] Connection header received
0807 00:35:13.169505 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.169506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.169518 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.169586 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.170760 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.171363 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.172459 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.172651 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.172726 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.175159 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.175161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.175161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:13.175170 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.176732 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:13.177185 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:13.177186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:13.177187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:13.177250 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:13.177496 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:13.177498 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:13.177498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:13.177648 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.177743 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.178046 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.178145 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:35:13.178452 13041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.168620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41295 (local address 127.7.252.3:52879)
0807 00:35:13.168786 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.168833 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.169390 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.169722 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.169727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.170013 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.170601 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.170607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.171461 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.171462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.172353 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.172356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.172735 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.172736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.172841 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.173436 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:13.173444 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.175041 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.176827 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:13.176834 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:13.176836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:13.177060 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:13.177305 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:13.177305 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:13.177306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:13.177413 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:13.177735 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.177742 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.177908 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.178023 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.178195 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260807 00:35:13.179107 13039 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41295
I20260807 00:35:13.179308 13039 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:13.179486 13039 heartbeater.cc:511] Master 127.7.252.62:41295 requested a full tablet report, sending...
I20260807 00:35:13.179847 12554 ts_manager.cc:194] Registered new tserver with Master: 1e34a8a5e21a4b57acb04e8d9a0d9b28 (127.7.252.3:33657)
I20260807 00:35:13.180230 12554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:52879
I20260807 00:35:13.189428 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:35:13.197763 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.190920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41140 (local address 127.7.252.62:41295)
0807 00:35:13.191036 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.191038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.191157 (+ 119us) server_negotiation.cc:407] Connection header received
0807 00:35:13.191266 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.191267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.191278 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.191332 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.191952 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.192510 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.193257 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.193466 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.193547 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.194872 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.194874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.194874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:13.194881 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.196405 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:13.196802 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:13.196804 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:13.196805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:13.196868 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:13.197079 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:13.197080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:13.197081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:13.197324 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.197459 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.197553 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.197653 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 00:35:13.199968 12554 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:13.201619 12554 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:13.209052 13054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.204709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:36751 (local address 127.0.0.1:56076)
0807 00:35:13.204832 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.204843 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.204884 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.205274 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.205278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.205280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.205370 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.205373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.206454 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.206455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.207821 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.207825 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.208826 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.208901 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.208904 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.208953 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.208985 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":4,"thread_start_us":88,"threads_started":1}
I20260807 00:35:13.209214 13053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.204395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:33657 (local address 127.0.0.1:40890)
0807 00:35:13.204617 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.204628 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.204730 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.205407 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.205408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.205410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.205467 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.205469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.206894 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.206895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.208047 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.208049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.208965 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.209034 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.209038 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.209091 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.209134 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":30,"thread_start_us":180,"threads_started":1}
I20260807 00:35:13.209237 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.204971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40890 (local address 127.7.252.3:33657)
0807 00:35:13.205228 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.205232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.205243 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:13.205284 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.205286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.205303 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.205545 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.205624 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.206780 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208131 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.208843 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208942 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.209001 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.209113 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.209154 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":131,"threads_started":1}
I20260807 00:35:13.209266 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.204865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56076 (local address 127.7.252.2:36751)
0807 00:35:13.205047 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.205053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.205065 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:35:13.205109 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.205112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.205128 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.205453 (+ 325us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.205555 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.206338 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.207922 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.208697 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208821 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.208890 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.209097 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.209161 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
I20260807 00:35:13.210294 12829 tablet_service.cc:1467] Processing CreateTablet for tablet bd3c6641cb004182b10258d435fdcfaa (DEFAULT_TABLE table=test-table [id=2933bc4f26af453da8868526cac927cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:13.210304 12969 tablet_service.cc:1467] Processing CreateTablet for tablet bd3c6641cb004182b10258d435fdcfaa (DEFAULT_TABLE table=test-table [id=2933bc4f26af453da8868526cac927cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:13.210675 12969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3c6641cb004182b10258d435fdcfaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.210714 12829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3c6641cb004182b10258d435fdcfaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.209052 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.204286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:44015 (local address 127.0.0.1:50248)
0807 00:35:13.204412 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.204453 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.204518 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.205487 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.205488 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.205490 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.205527 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.205528 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.206910 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.206911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.207914 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.207917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.208699 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.208790 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.208805 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.208874 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.208943 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":53,"thread_start_us":77,"threads_started":1}
I20260807 00:35:13.210911 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.204999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50248 (local address 127.7.252.1:44015)
0807 00:35:13.205250 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.205254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.205264 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:13.205301 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.205303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.205317 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.205393 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.205617 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.206780 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.207995 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.208573 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.208676 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.208747 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.210758 (+ 2011us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.210815 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":109,"threads_started":1}
I20260807 00:35:13.211654 12687 tablet_service.cc:1467] Processing CreateTablet for tablet bd3c6641cb004182b10258d435fdcfaa (DEFAULT_TABLE table=test-table [id=2933bc4f26af453da8868526cac927cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:13.211985 12687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3c6641cb004182b10258d435fdcfaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.213639 13058 tablet_bootstrap.cc:492] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Bootstrap starting.
I20260807 00:35:13.214280 13059 tablet_bootstrap.cc:492] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Bootstrap starting.
I20260807 00:35:13.214474 13058 tablet_bootstrap.cc:654] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.215112 13059 tablet_bootstrap.cc:654] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.215179 13058 log.cc:824] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.215547 13060 tablet_bootstrap.cc:492] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: Bootstrap starting.
I20260807 00:35:13.215760 13059 log.cc:824] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.216343 13060 tablet_bootstrap.cc:654] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.216722 13059 tablet_bootstrap.cc:492] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: No bootstrap required, opened a new log
I20260807 00:35:13.216776 13058 tablet_bootstrap.cc:492] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: No bootstrap required, opened a new log
I20260807 00:35:13.216816 13059 ts_tablet_manager.cc:1397] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:35:13.216915 13058 ts_tablet_manager.cc:1397] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:35:13.216982 13060 log.cc:824] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.217825 13060 tablet_bootstrap.cc:492] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: No bootstrap required, opened a new log
I20260807 00:35:13.217911 13060 ts_tablet_manager.cc:1397] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:35:13.218598 13059 raft_consensus.cc:348] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.218849 13059 raft_consensus.cc:374] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.218902 13059 raft_consensus.cc:729] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a76b30898c24604b3d22c1588aa4bab, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.219022 13059 consensus_queue.cc:260] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.219067 13058 raft_consensus.cc:348] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.219231 13058 raft_consensus.cc:374] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.219272 13058 raft_consensus.cc:729] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e34a8a5e21a4b57acb04e8d9a0d9b28, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.219319 12900 heartbeater.cc:503] Master 127.7.252.62:41295 was elected leader, sending a full tablet report...
I20260807 00:35:13.219558 13058 consensus_queue.cc:260] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.219902 13058 ts_tablet_manager.cc:1428] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:13.219944 13039 heartbeater.cc:503] Master 127.7.252.62:41295 was elected leader, sending a full tablet report...
I20260807 00:35:13.219324 13059 ts_tablet_manager.cc:1428] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 00:35:13.220156 13060 raft_consensus.cc:348] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.220337 13060 raft_consensus.cc:374] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.220376 13060 raft_consensus.cc:729] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f155cbc833994fa1bfa5e33c58635101, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.220507 13060 consensus_queue.cc:260] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.220815 13060 ts_tablet_manager.cc:1428] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:13.220913 12757 heartbeater.cc:503] Master 127.7.252.62:41295 was elected leader, sending a full tablet report...
I20260807 00:35:13.228886 13067 raft_consensus.cc:482] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:13.229012 13067 raft_consensus.cc:504] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.229506 13067 leader_election.cc:288] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e34a8a5e21a4b57acb04e8d9a0d9b28 (127.7.252.3:33657), 6a76b30898c24604b3d22c1588aa4bab (127.7.252.2:36751)
I20260807 00:35:13.233872 12759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.229700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:33657 (local address 127.7.252.1:41457)
0807 00:35:13.229807 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.229820 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.229879 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.230087 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.230088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.230091 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.230175 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.230177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.231216 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.231218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.232692 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.232696 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.233525 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.233526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.233637 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.233640 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.233706 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.233769 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":73}
I20260807 00:35:13.233946 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.229747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:41457 (local address 127.7.252.3:33657)
0807 00:35:13.229814 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.229817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.229962 (+ 145us) server_negotiation.cc:407] Connection header received
0807 00:35:13.229996 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.229997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.230011 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.230060 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.230271 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.231097 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.232803 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.233394 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.233481 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.233493 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.233818 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.233873 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 00:35:13.234031 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.229910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:51087 (local address 127.7.252.2:36751)
0807 00:35:13.229986 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.229988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.230102 (+ 114us) server_negotiation.cc:407] Connection header received
0807 00:35:13.230138 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.230139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.230150 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.230204 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.230366 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.231076 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.232804 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.233423 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.233487 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.233495 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.233906 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.233954 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:35:13.233878 13068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.229807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:36751 (local address 127.7.252.1:51087)
0807 00:35:13.230013 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.230022 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.230095 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.230228 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.230229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.230231 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.230300 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.230301 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.231217 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.231218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.232696 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.232697 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.233525 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.233526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.233618 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.233623 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.233706 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.233769 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":163,"thread_start_us":123,"threads_started":1}
I20260807 00:35:13.234254 12990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6641cb004182b10258d435fdcfaa" candidate_uuid: "f155cbc833994fa1bfa5e33c58635101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" is_pre_election: true
I20260807 00:35:13.233965 13066 raft_consensus.cc:482] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:13.234543 12850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6641cb004182b10258d435fdcfaa" candidate_uuid: "f155cbc833994fa1bfa5e33c58635101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a76b30898c24604b3d22c1588aa4bab" is_pre_election: true
I20260807 00:35:13.234717 12850 raft_consensus.cc:2454] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f155cbc833994fa1bfa5e33c58635101 in term 0.
I20260807 00:35:13.234731 13066 raft_consensus.cc:504] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.234881 12990 raft_consensus.cc:2454] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f155cbc833994fa1bfa5e33c58635101 in term 0.
I20260807 00:35:13.234999 12639 leader_election.cc:302] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a76b30898c24604b3d22c1588aa4bab, f155cbc833994fa1bfa5e33c58635101; no voters:
I20260807 00:35:13.235065 13066 leader_election.cc:288] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a76b30898c24604b3d22c1588aa4bab (127.7.252.2:36751), f155cbc833994fa1bfa5e33c58635101 (127.7.252.1:44015)
I20260807 00:35:13.235283 13067 raft_consensus.cc:2781] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:13.235370 13067 raft_consensus.cc:482] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:13.235443 13067 raft_consensus.cc:3037] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.236503 13067 raft_consensus.cc:504] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.236784 13067 leader_election.cc:288] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [CANDIDATE]: Term 1 election: Requested vote from peers 1e34a8a5e21a4b57acb04e8d9a0d9b28 (127.7.252.3:33657), 6a76b30898c24604b3d22c1588aa4bab (127.7.252.2:36751)
I20260807 00:35:13.236860 12850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6641cb004182b10258d435fdcfaa" candidate_uuid: "f155cbc833994fa1bfa5e33c58635101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a76b30898c24604b3d22c1588aa4bab"
I20260807 00:35:13.236933 12990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6641cb004182b10258d435fdcfaa" candidate_uuid: "f155cbc833994fa1bfa5e33c58635101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28"
I20260807 00:35:13.236969 12850 raft_consensus.cc:3037] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.236999 12990 raft_consensus.cc:3037] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.237908 12990 raft_consensus.cc:2454] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f155cbc833994fa1bfa5e33c58635101 in term 1.
I20260807 00:35:13.237908 12850 raft_consensus.cc:2454] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f155cbc833994fa1bfa5e33c58635101 in term 1.
I20260807 00:35:13.238114 12639 leader_election.cc:302] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a76b30898c24604b3d22c1588aa4bab, f155cbc833994fa1bfa5e33c58635101; no voters:
I20260807 00:35:13.238261 13067 raft_consensus.cc:2781] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:13.238471 13067 raft_consensus.cc:686] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [term 1 LEADER]: Becoming Leader. State: Replica: f155cbc833994fa1bfa5e33c58635101, State: Running, Role: LEADER
I20260807 00:35:13.238580 13067 consensus_queue.cc:237] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } }
I20260807 00:35:13.238691 13041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.235247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:44015 (local address 127.7.252.3:53929)
0807 00:35:13.235302 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.235314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.235360 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.235551 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.235552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.235554 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.235618 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.235619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.236521 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.236522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.237611 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.237614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.238363 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.238364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.238478 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.238482 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.238545 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.238592 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 00:35:13.238835 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.235267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:53929 (local address 127.7.252.1:44015)
0807 00:35:13.235306 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.235308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.235344 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:35:13.235433 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.235434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.235444 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.235490 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.235742 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.236434 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.237704 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.238288 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.238365 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.238376 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.238608 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.238748 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:35:13.239053 12709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6641cb004182b10258d435fdcfaa" candidate_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f155cbc833994fa1bfa5e33c58635101" is_pre_election: true
I20260807 00:35:13.239476 12554 catalog_manager.cc:5495] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 reported cstate change: term changed from 0 to 1, leader changed from <none> to f155cbc833994fa1bfa5e33c58635101 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "f155cbc833994fa1bfa5e33c58635101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f155cbc833994fa1bfa5e33c58635101" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 44015 } health_report { overall_health: HEALTHY } } }
I20260807 00:35:13.240113 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.235575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:54073 (local address 127.7.252.2:36751)
0807 00:35:13.235614 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.235616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.235624 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:13.235646 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.235647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.235655 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.235711 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:13.235899 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.236582 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.239229 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.239768 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.239849 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.239861 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.240031 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.240067 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:35:13.240154 13069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.235336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:36751 (local address 127.7.252.3:54073)
0807 00:35:13.235514 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.235524 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.235567 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.235756 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.235757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.235759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:13.235821 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.235822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.236687 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.236688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.239103 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:13.239107 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.239870 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.239871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:13.239937 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.239943 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.240028 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.240069 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":125,"threads_started":1}
W20260807 00:35:13.240427 12901 tablet.cc:2369] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:13.240427 12850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6641cb004182b10258d435fdcfaa" candidate_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a76b30898c24604b3d22c1588aa4bab" is_pre_election: true
I20260807 00:35:13.240551 12850 raft_consensus.cc:2379] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e34a8a5e21a4b57acb04e8d9a0d9b28 in current term 1: Already voted for candidate f155cbc833994fa1bfa5e33c58635101 in this term.
I20260807 00:35:13.240868 12921 leader_election.cc:302] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e34a8a5e21a4b57acb04e8d9a0d9b28; no voters: 6a76b30898c24604b3d22c1588aa4bab, f155cbc833994fa1bfa5e33c58635101
I20260807 00:35:13.241060 13066 raft_consensus.cc:2726] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 00:35:13.249044 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.246293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50250 (local address 127.7.252.1:44015)
0807 00:35:13.246368 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.246370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.246380 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:13.246480 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.246481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.246504 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.246590 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:13.246746 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.247242 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.248073 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:13.248334 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:13.248430 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:13.248615 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:13.248744 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:13.248844 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.248900 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.248926 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:35:13.251322 12850 raft_consensus.cc:1261] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 1 FOLLOWER]: Refusing update from remote peer f155cbc833994fa1bfa5e33c58635101: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:13.251443 12990 raft_consensus.cc:1261] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 1 FOLLOWER]: Refusing update from remote peer f155cbc833994fa1bfa5e33c58635101: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:13.251691 13070 consensus_queue.cc:1035] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a76b30898c24604b3d22c1588aa4bab" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:13.251853 13067 consensus_queue.cc:1035] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e34a8a5e21a4b57acb04e8d9a0d9b28" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:13.254683 13074 mvcc.cc:205] Tried to move back new op lower bound from 7315713692674093056 to 7315713692626006016. Current Snapshot: MvccSnapshot[applied={T|T < 7315713692674093056}]
I20260807 00:35:13.256969 12554 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:13.257062 12554 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:13.257915 12554 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 975df86ee1eb4998a3793e9d10f91fc8: Sending DeleteTablet for 3 replicas of tablet bd3c6641cb004182b10258d435fdcfaa
I20260807 00:35:13.258327 12969 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3c6641cb004182b10258d435fdcfaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:13 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:40890
I20260807 00:35:13.258412 12829 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3c6641cb004182b10258d435fdcfaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:13 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:56076
I20260807 00:35:13.258591 12687 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3c6641cb004182b10258d435fdcfaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:13 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:50248
I20260807 00:35:13.258872 13085 tablet_replica.cc:330] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: stopping tablet replica
I20260807 00:35:13.258885 13086 tablet_replica.cc:330] T bd3c6641cb004182b10258d435fdcfaa P f155cbc833994fa1bfa5e33c58635101: stopping tablet replica
I20260807 00:35:13.258970 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12623
I20260807 00:35:13.259001 13085 raft_consensus.cc:2229] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:13.259123 13085 raft_consensus.cc:2258] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:13.260269 13085 ts_tablet_manager.cc:1905] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:13.262110 13084 tablet_replica.cc:330] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: stopping tablet replica
I20260807 00:35:13.262283 13084 raft_consensus.cc:2229] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:13.262422 13084 raft_consensus.cc:2258] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:13.262436 13085 ts_tablet_manager.cc:1918] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:13.262518 13085 log.cc:1196] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/bd3c6641cb004182b10258d435fdcfaa
I20260807 00:35:13.262907 13084 ts_tablet_manager.cc:1905] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:13.263070 13085 ts_tablet_manager.cc:1939] T bd3c6641cb004182b10258d435fdcfaa P 6a76b30898c24604b3d22c1588aa4bab: Deleting consensus metadata
I20260807 00:35:13.263581 12537 catalog_manager.cc:4841] TS 6a76b30898c24604b3d22c1588aa4bab (127.7.252.2:36751): tablet bd3c6641cb004182b10258d435fdcfaa (table test-table [id=2933bc4f26af453da8868526cac927cb]) successfully deleted
I20260807 00:35:13.264730 13084 ts_tablet_manager.cc:1918] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:13.264840 13084 log.cc:1196] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/bd3c6641cb004182b10258d435fdcfaa
I20260807 00:35:13.265100 13084 ts_tablet_manager.cc:1939] T bd3c6641cb004182b10258d435fdcfaa P 1e34a8a5e21a4b57acb04e8d9a0d9b28: Deleting consensus metadata
I20260807 00:35:13.265681 12537 catalog_manager.cc:4841] TS 1e34a8a5e21a4b57acb04e8d9a0d9b28 (127.7.252.3:33657): tablet bd3c6641cb004182b10258d435fdcfaa (table test-table [id=2933bc4f26af453da8868526cac927cb]) successfully deleted
W20260807 00:35:13.266707 12538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:44015 (error 108)
I20260807 00:35:13.266976 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12763
I20260807 00:35:13.268887 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.268692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:44015 (local address 127.0.0.1:50254)
0807 00:35:13.268766 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.268820 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 00:35:13.269062 12538 catalog_manager.cc:4584] TS f155cbc833994fa1bfa5e33c58635101 (127.7.252.1:44015): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd3c6641cb004182b10258d435fdcfaa: Network error: Client connection negotiation failed: client connection to 127.7.252.1:44015: connect: Connection refused (error 111)
I20260807 00:35:13.274744 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12905
I20260807 00:35:13.281138 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 12520
2026-08-07T00:35:13Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2039 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T00:35:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:13Z Disabled control of system clock
I20260807 00:35:13.312480 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:45747
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:43415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:45747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 00:35:13.395679 13092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:13.395920 13092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:13.395943 13092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:13.397086 13092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:13.397127 13092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:13.397141 13092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:13.397153 13092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:13.397166 13092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:13.398488 13092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:45747
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:45747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:13.398780 13092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:13.399046 13092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:13.404592 13092 server_base.cc:1034] running on GCE node
W20260807 00:35:13.404726 13100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.404552 13097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.404556 13098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.405174 13092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:13.405539 13092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:13.406766 13092 hybrid_clock.cc:648] HybridClock initialized: now 1786062913406723 us; error 67 us; skew 500 ppm
I20260807 00:35:13.408353 13092 webserver.cc:460] Webserver started at http://127.7.252.62:36721/ using document root <none> and password file <none>
I20260807 00:35:13.408664 13092 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:13.408730 13092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:13.408905 13092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:13.410095 13092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "5bd0aef7f87d47cf96d903b98e4525c2"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "fd1820ee1585b541ff041cc032a12337"
server_key_iv: "e38d68303fccd66b47d3b76506ec2246"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.410495 13092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "5bd0aef7f87d47cf96d903b98e4525c2"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "fd1820ee1585b541ff041cc032a12337"
server_key_iv: "e38d68303fccd66b47d3b76506ec2246"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.412050 13092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:13.413019 13107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.413372 13092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:13.413508 13092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "5bd0aef7f87d47cf96d903b98e4525c2"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "fd1820ee1585b541ff041cc032a12337"
server_key_iv: "e38d68303fccd66b47d3b76506ec2246"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.413597 13092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:13.417362 13092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:13.417661 13092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:13.417814 13092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:13.422228 13092 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:45747
I20260807 00:35:13.422392 13163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:45747 every 8 connection(s)
I20260807 00:35:13.422760 13092 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:13.423558 13164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.426637 13164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2: Bootstrap starting.
I20260807 00:35:13.427325 13164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.427693 13164 log.cc:824] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.427697 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13092
I20260807 00:35:13.427826 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:13.428036 8176 external_mini_cluster.cc:1428] Setting key d7320ac43faf9f6bd52e36ea188b091d
I20260807 00:35:13.428603 13164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2: No bootstrap required, opened a new log
I20260807 00:35:13.431030 13164 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45747 } }
I20260807 00:35:13.431246 13164 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.431293 13164 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd0aef7f87d47cf96d903b98e4525c2, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.431457 13164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45747 } }
I20260807 00:35:13.431582 13164 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:13.431661 13164 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:13.431720 13164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.431865 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.428678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37176 (local address 127.7.252.62:45747)
0807 00:35:13.428907 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.428917 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.428954 (+ 37us) server_negotiation.cc:407] Connection header received
0807 00:35:13.429981 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.429993 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.430053 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.430230 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.431086 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.431090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.431090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.431095 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.431146 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.431161 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.431244 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.431533 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.431600 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260807 00:35:13.432660 13164 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45747 } }
I20260807 00:35:13.432781 13164 leader_election.cc:302] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bd0aef7f87d47cf96d903b98e4525c2; no voters:
I20260807 00:35:13.432972 13164 leader_election.cc:288] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:13.433184 13170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:13.433338 13164 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:13.433360 13170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [term 1 LEADER]: Becoming Leader. State: Replica: 5bd0aef7f87d47cf96d903b98e4525c2, State: Running, Role: LEADER
I20260807 00:35:13.433554 13170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45747 } }
I20260807 00:35:13.433969 13171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45747 } } }
I20260807 00:35:13.434082 13171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:13.434242 13172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bd0aef7f87d47cf96d903b98e4525c2. Latest consensus state: current_term: 1 leader_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bd0aef7f87d47cf96d903b98e4525c2" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45747 } } }
I20260807 00:35:13.434306 13172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:13.434324 13179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:13.434885 13179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:13.436620 13179 catalog_manager.cc:1347] Generated new cluster ID: f0529e6865f24c73b231d226849c1c2e
I20260807 00:35:13.436669 13179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:13.445227 13179 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:13.445449 13179 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:13.454532 13179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2: Generated new TSK 0
I20260807 00:35:13.454836 13179 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:13.458326 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45747
--builtin_ntp_servers=127.7.252.20:43415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 00:35:13.554602 13189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:13.554967 13189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:13.555009 13189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:13.556253 13189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:13.556322 13189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:13.556363 13189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:13.557744 13189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:13.558022 13189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:13.558338 13189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:13.563728 13194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.563728 13195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.563951 13197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.564198 13189 server_base.cc:1034] running on GCE node
I20260807 00:35:13.564417 13189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:13.564738 13189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:13.565912 13189 hybrid_clock.cc:648] HybridClock initialized: now 1786062913565886 us; error 43 us; skew 500 ppm
I20260807 00:35:13.567559 13189 webserver.cc:460] Webserver started at http://127.7.252.1:41385/ using document root <none> and password file <none>
I20260807 00:35:13.567855 13189 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:13.567935 13189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:13.568118 13189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:13.569336 13189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "68a5669a4fbd4de6b4800d6ce778b416"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "1ad7c86f0e577e3e80ebf7b3dc414ee5"
server_key_iv: "c518f0b21571eb01eb38e63b7865fc38"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.569748 13189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "68a5669a4fbd4de6b4800d6ce778b416"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "1ad7c86f0e577e3e80ebf7b3dc414ee5"
server_key_iv: "c518f0b21571eb01eb38e63b7865fc38"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.571383 13189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260807 00:35:13.572274 13203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.572481 13189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:13.572607 13189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "68a5669a4fbd4de6b4800d6ce778b416"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "1ad7c86f0e577e3e80ebf7b3dc414ee5"
server_key_iv: "c518f0b21571eb01eb38e63b7865fc38"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.572703 13189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:13.576742 13189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:13.577057 13189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:13.577222 13189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:13.577512 13189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:13.577930 13189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:13.577971 13189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.577996 13189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:13.578034 13189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.585073 13189 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:38059
I20260807 00:35:13.585248 13320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:38059 every 8 connection(s)
I20260807 00:35:13.585589 13189 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:13.589072 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.586629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:46241 (local address 127.7.252.62:45747)
0807 00:35:13.586744 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.586746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.586880 (+ 134us) server_negotiation.cc:407] Connection header received
0807 00:35:13.587416 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.587418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.587434 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.587517 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.588854 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.588855 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.588856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.588860 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.588875 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.588879 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.588944 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.589004 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.589017 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 00:35:13.589335 13323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.586476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45747 (local address 127.7.252.1:46241)
0807 00:35:13.586731 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.586778 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.587284 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.587575 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.587579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.587587 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.588672 (+ 1085us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.588673 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.588706 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.588739 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.588939 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.588942 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.588944 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.589002 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.589055 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260807 00:35:13.590005 13321 heartbeater.cc:347] Connected to a master server at 127.7.252.62:45747
I20260807 00:35:13.590092 13321 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:13.590289 13321 heartbeater.cc:511] Master 127.7.252.62:45747 requested a full tablet report, sending...
I20260807 00:35:13.590988 13125 ts_manager.cc:194] Registered new tserver with Master: 68a5669a4fbd4de6b4800d6ce778b416 (127.7.252.1:38059)
I20260807 00:35:13.595604 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13189
I20260807 00:35:13.595788 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:13.595975 8176 external_mini_cluster.cc:1428] Setting key 30fde245247d5414aac1dd99f66b64cf
I20260807 00:35:13.597036 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45747
--builtin_ntp_servers=127.7.252.20:43415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 00:35:13.682302 13324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:13.682559 13324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:13.682583 13324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:13.683872 13324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:13.683919 13324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:13.683952 13324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:13.685322 13324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:13.685530 13324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:13.685797 13324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:13.691380 13330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.691380 13333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.691401 13331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.691928 13324 server_base.cc:1034] running on GCE node
I20260807 00:35:13.692175 13324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:13.692476 13324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:13.693663 13324 hybrid_clock.cc:648] HybridClock initialized: now 1786062913693635 us; error 44 us; skew 500 ppm
I20260807 00:35:13.695402 13324 webserver.cc:460] Webserver started at http://127.7.252.2:33471/ using document root <none> and password file <none>
I20260807 00:35:13.695732 13324 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:13.695823 13324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:13.696007 13324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:13.697322 13324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "fbe857dea90442b6ace728f73e454115"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "0f0781e05dfb00eae1ef61b5845eaadb"
server_key_iv: "fc912764ff4a439b544f72228e7d32d5"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.697741 13324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "fbe857dea90442b6ace728f73e454115"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "0f0781e05dfb00eae1ef61b5845eaadb"
server_key_iv: "fc912764ff4a439b544f72228e7d32d5"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.699321 13324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260807 00:35:13.700356 13339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.700667 13324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:13.700801 13324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "fbe857dea90442b6ace728f73e454115"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "0f0781e05dfb00eae1ef61b5845eaadb"
server_key_iv: "fc912764ff4a439b544f72228e7d32d5"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.700888 13324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:13.704842 13324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:13.705128 13324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:13.705294 13324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:13.705510 13324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:13.705855 13324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:13.705922 13324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.705963 13324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:13.705993 13324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.713318 13324 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:42889
I20260807 00:35:13.713362 13459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:42889 every 8 connection(s)
I20260807 00:35:13.713842 13324 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:13.717651 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.714893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:49943 (local address 127.7.252.62:45747)
0807 00:35:13.714966 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.714968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.715172 (+ 204us) server_negotiation.cc:407] Connection header received
0807 00:35:13.715662 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.715663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.715670 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.715744 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.717358 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.717360 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.717360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.717366 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.717385 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.717390 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.717470 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.717554 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.717571 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 00:35:13.717882 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.714823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45747 (local address 127.7.252.2:49943)
0807 00:35:13.715023 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.715067 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.715552 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.715824 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.715828 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.715837 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.717030 (+ 1193us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.717031 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.717062 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.717117 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.717469 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.717477 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.717480 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.717567 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.717637 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260807 00:35:13.718502 13460 heartbeater.cc:347] Connected to a master server at 127.7.252.62:45747
I20260807 00:35:13.718595 13460 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:13.718986 13460 heartbeater.cc:511] Master 127.7.252.62:45747 requested a full tablet report, sending...
I20260807 00:35:13.719519 13125 ts_manager.cc:194] Registered new tserver with Master: fbe857dea90442b6ace728f73e454115 (127.7.252.2:42889)
I20260807 00:35:13.723578 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13324
I20260807 00:35:13.723666 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:13.723912 8176 external_mini_cluster.cc:1428] Setting key 252dabca77d12ac0cbc54b9fae7480f1
I20260807 00:35:13.725232 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45747
--builtin_ntp_servers=127.7.252.20:43415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 00:35:13.809005 13463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:13.809216 13463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:13.809245 13463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:13.810396 13463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:13.810436 13463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:13.810462 13463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:13.811879 13463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:13.812094 13463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:13.812446 13463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:13.817942 13468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:13.817920 13471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.817955 13463 server_base.cc:1034] running on GCE node
W20260807 00:35:13.817909 13469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:13.818452 13463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:13.818796 13463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:13.819990 13463 hybrid_clock.cc:648] HybridClock initialized: now 1786062913819980 us; error 32 us; skew 500 ppm
I20260807 00:35:13.821470 13463 webserver.cc:460] Webserver started at http://127.7.252.3:44953/ using document root <none> and password file <none>
I20260807 00:35:13.821785 13463 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:13.821873 13463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:13.822050 13463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:13.823346 13463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "d632ced116294bc1b7d25c33509a78c6"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "b53632867cee5aaceeac344a56f8cce6"
server_key_iv: "7bdfccce627c32b7601117822108a1e8"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.823746 13463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "d632ced116294bc1b7d25c33509a78c6"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "b53632867cee5aaceeac344a56f8cce6"
server_key_iv: "7bdfccce627c32b7601117822108a1e8"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.825459 13463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:13.826471 13477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.826747 13463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:13.826865 13463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "d632ced116294bc1b7d25c33509a78c6"
format_stamp: "Formatted at 2026-08-07 00:35:13 on dist-test-slave-csg5"
server_key: "b53632867cee5aaceeac344a56f8cce6"
server_key_iv: "7bdfccce627c32b7601117822108a1e8"
server_key_version: "encryptionkey@0"
I20260807 00:35:13.826962 13463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:13.830991 13463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:13.831314 13463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:13.831481 13463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:13.831717 13463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:13.832062 13463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:13.832123 13463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.832167 13463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:13.832197 13463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:13.839183 13463 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:42485
I20260807 00:35:13.839290 13595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:42485 every 8 connection(s)
I20260807 00:35:13.839670 13463 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:13.841085 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13463
I20260807 00:35:13.841179 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:13.841424 8176 external_mini_cluster.cc:1428] Setting key 9f1c18ac56c47086c4861e607cd2e6cc
I20260807 00:35:13.843032 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.840516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:56853 (local address 127.7.252.62:45747)
0807 00:35:13.840589 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.840591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.840830 (+ 239us) server_negotiation.cc:407] Connection header received
0807 00:35:13.841435 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.841437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.841443 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.841490 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.842809 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.842810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.842810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.842815 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.842835 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.842840 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.842909 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.842960 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.842973 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:35:13.843269 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.840504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45747 (local address 127.7.252.3:56853)
0807 00:35:13.840690 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.840725 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.841304 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.841671 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.841674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.841683 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.842607 (+ 924us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.842608 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.842638 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.842720 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.842909 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.842911 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.842914 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.842966 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.843017 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":97,"threads_started":1}
I20260807 00:35:13.843886 13596 heartbeater.cc:347] Connected to a master server at 127.7.252.62:45747
I20260807 00:35:13.843995 13596 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:13.844153 13596 heartbeater.cc:511] Master 127.7.252.62:45747 requested a full tablet report, sending...
I20260807 00:35:13.844552 13125 ts_manager.cc:194] Registered new tserver with Master: d632ced116294bc1b7d25c33509a78c6 (127.7.252.3:42485)
I20260807 00:35:13.854176 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:35:13.857232 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.855863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.7.252.62:45747)
0807 00:35:13.855935 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.855937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.856046 (+ 109us) server_negotiation.cc:407] Connection header received
0807 00:35:13.856126 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.856127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.856132 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.856188 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.856951 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.856953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.856953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.856958 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.856975 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.856979 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.857050 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.857159 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.857171 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 00:35:13.858916 13125 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:13.860594 13125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:13.864992 13606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.863065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:38059 (local address 127.0.0.1:44468)
0807 00:35:13.863522 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.863534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.863587 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.863850 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.863857 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.863864 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.864422 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.864423 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.864442 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.864469 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.864840 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.864841 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.864841 (+ 0us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.864884 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.864899 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":100,"threads_started":1}
I20260807 00:35:13.865002 13609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.863250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44468 (local address 127.7.252.1:38059)
0807 00:35:13.863726 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.863731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.863741 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:13.863767 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.863769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.863779 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.863851 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.864542 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.864550 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.864551 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.864555 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.864589 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.864612 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.864675 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.864898 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.864915 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":87,"threads_started":1}
I20260807 00:35:13.865020 13605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.863065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:42485 (local address 127.0.0.1:37530)
0807 00:35:13.863274 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.863317 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.863376 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.864044 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.864046 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.864048 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.864585 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.864585 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.864590 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.864601 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.864792 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.864816 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.864821 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.864891 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.864905 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":87,"threads_started":1}
I20260807 00:35:13.865253 13607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.863082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:42889 (local address 127.0.0.1:39084)
0807 00:35:13.863522 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.863534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.863587 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.864341 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.864342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.864345 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.864732 (+ 387us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.864732 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.864740 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.864753 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.865011 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.865012 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.865013 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.865056 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.865196 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":119,"threads_started":1}
I20260807 00:35:13.865367 13608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.863271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.7.252.3:42485)
0807 00:35:13.863577 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.863582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.863606 (+ 24us) server_negotiation.cc:407] Connection header received
0807 00:35:13.863634 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.863636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.863647 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.863719 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.864662 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.864669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.864670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.864674 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.864713 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.864733 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.864798 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.865240 (+ 442us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.865254 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":86,"threads_started":1}
I20260807 00:35:13.865516 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.863339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39084 (local address 127.7.252.2:42889)
0807 00:35:13.864195 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.864199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.864207 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:13.864228 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.864229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.864235 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.864340 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.864848 (+ 508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.864856 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.864857 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.864861 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.864897 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.864923 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.864984 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.865405 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.865422 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":82,"threads_started":1}
I20260807 00:35:13.866189 13388 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd984d92c274a40bcc4c96fd9781139 (DEFAULT_TABLE table=test-table [id=85d489afbd7e475a9e5e1327de52653c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:13.866194 13252 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd984d92c274a40bcc4c96fd9781139 (DEFAULT_TABLE table=test-table [id=85d489afbd7e475a9e5e1327de52653c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:13.866566 13388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd984d92c274a40bcc4c96fd9781139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.866566 13252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd984d92c274a40bcc4c96fd9781139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.870036 13612 tablet_bootstrap.cc:492] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416: Bootstrap starting.
I20260807 00:35:13.870036 13611 tablet_bootstrap.cc:492] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Bootstrap starting.
I20260807 00:35:13.870441 13528 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd984d92c274a40bcc4c96fd9781139 (DEFAULT_TABLE table=test-table [id=85d489afbd7e475a9e5e1327de52653c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:13.870797 13528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd984d92c274a40bcc4c96fd9781139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:13.870852 13612 tablet_bootstrap.cc:654] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.870852 13611 tablet_bootstrap.cc:654] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.871201 13611 log.cc:824] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.871194 13612 log.cc:824] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.872061 13611 tablet_bootstrap.cc:492] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: No bootstrap required, opened a new log
I20260807 00:35:13.872061 13612 tablet_bootstrap.cc:492] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416: No bootstrap required, opened a new log
I20260807 00:35:13.872128 13611 ts_tablet_manager.cc:1397] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 00:35:13.872128 13612 ts_tablet_manager.cc:1397] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 00:35:13.873513 13615 tablet_bootstrap.cc:492] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Bootstrap starting.
I20260807 00:35:13.874353 13615 tablet_bootstrap.cc:654] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:13.874737 13615 log.cc:824] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:13.874995 13611 raft_consensus.cc:348] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.875201 13611 raft_consensus.cc:374] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.875149 13612 raft_consensus.cc:348] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.875291 13612 raft_consensus.cc:374] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.875250 13611 raft_consensus.cc:729] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe857dea90442b6ace728f73e454115, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.875329 13612 raft_consensus.cc:729] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68a5669a4fbd4de6b4800d6ce778b416, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.875442 13612 consensus_queue.cc:260] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.875425 13611 consensus_queue.cc:260] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.875734 13612 ts_tablet_manager.cc:1428] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260807 00:35:13.875734 13611 ts_tablet_manager.cc:1428] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260807 00:35:13.875766 13615 tablet_bootstrap.cc:492] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: No bootstrap required, opened a new log
I20260807 00:35:13.875836 13615 ts_tablet_manager.cc:1397] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 00:35:13.875864 13460 heartbeater.cc:503] Master 127.7.252.62:45747 was elected leader, sending a full tablet report...
I20260807 00:35:13.876217 13321 heartbeater.cc:503] Master 127.7.252.62:45747 was elected leader, sending a full tablet report...
I20260807 00:35:13.878298 13615 raft_consensus.cc:348] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.878494 13615 raft_consensus.cc:374] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:13.878536 13615 raft_consensus.cc:729] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d632ced116294bc1b7d25c33509a78c6, State: Initialized, Role: FOLLOWER
I20260807 00:35:13.878695 13615 consensus_queue.cc:260] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.879029 13615 ts_tablet_manager.cc:1428] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 00:35:13.879113 13596 heartbeater.cc:503] Master 127.7.252.62:45747 was elected leader, sending a full tablet report...
W20260807 00:35:13.964565 13461 tablet.cc:2369] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:13.984241 13618 raft_consensus.cc:482] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:13.984424 13618 raft_consensus.cc:504] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.984885 13618 leader_election.cc:288] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d632ced116294bc1b7d25c33509a78c6 (127.7.252.3:42485), fbe857dea90442b6ace728f73e454115 (127.7.252.2:42889)
I20260807 00:35:13.986568 13608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.985330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:46347 (local address 127.7.252.3:42485)
0807 00:35:13.985394 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.985396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.985406 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:13.985432 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.985433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.985437 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.985519 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.986132 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.986134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.986135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.986139 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.986158 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.986162 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.986227 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.986465 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.986481 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 00:35:13.986584 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.985235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:35933 (local address 127.7.252.2:42889)
0807 00:35:13.985313 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:13.985315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:13.985464 (+ 149us) server_negotiation.cc:407] Connection header received
0807 00:35:13.985527 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:13.985528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:13.985534 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:13.985591 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:13.986340 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:13.986341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:13.986341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:13.986346 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:13.986362 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:13.986366 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:13.986420 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:13.986500 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 00:35:13.986515 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 00:35:13.986584 13323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.985057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:42485 (local address 127.7.252.1:46347)
0807 00:35:13.985126 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.985138 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.985202 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.985543 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.985544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.985547 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.986017 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.986018 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.986027 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.986039 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.986386 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.986387 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.986388 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.986461 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.986479 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 00:35:13.986598 13620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:13.985127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:42889 (local address 127.7.252.1:35933)
0807 00:35:13.985392 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:13.985405 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:13.985472 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:13.985596 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:13.985597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:13.985600 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:13.986218 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:13.986219 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:13.986227 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:13.986247 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:13.986427 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:13.986428 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:13.986428 (+ 0us) client_negotiation.cc:769] Sending connection context
0807 00:35:13.986478 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 00:35:13.986492 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":130,"threads_started":1}
I20260807 00:35:13.986995 13548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd984d92c274a40bcc4c96fd9781139" candidate_uuid: "68a5669a4fbd4de6b4800d6ce778b416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d632ced116294bc1b7d25c33509a78c6" is_pre_election: true
I20260807 00:35:13.987175 13548 raft_consensus.cc:2454] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68a5669a4fbd4de6b4800d6ce778b416 in term 0.
I20260807 00:35:13.987210 13410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd984d92c274a40bcc4c96fd9781139" candidate_uuid: "68a5669a4fbd4de6b4800d6ce778b416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe857dea90442b6ace728f73e454115" is_pre_election: true
I20260807 00:35:13.987387 13410 raft_consensus.cc:2454] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68a5669a4fbd4de6b4800d6ce778b416 in term 0.
I20260807 00:35:13.987511 13207 leader_election.cc:302] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68a5669a4fbd4de6b4800d6ce778b416, d632ced116294bc1b7d25c33509a78c6; no voters:
I20260807 00:35:13.987699 13618 raft_consensus.cc:2781] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:13.987782 13618 raft_consensus.cc:482] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:13.987819 13618 raft_consensus.cc:3037] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.988590 13618 raft_consensus.cc:504] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.988749 13618 leader_election.cc:288] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [CANDIDATE]: Term 1 election: Requested vote from peers d632ced116294bc1b7d25c33509a78c6 (127.7.252.3:42485), fbe857dea90442b6ace728f73e454115 (127.7.252.2:42889)
I20260807 00:35:13.988907 13410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd984d92c274a40bcc4c96fd9781139" candidate_uuid: "68a5669a4fbd4de6b4800d6ce778b416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe857dea90442b6ace728f73e454115"
I20260807 00:35:13.989007 13410 raft_consensus.cc:3037] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.988991 13548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd984d92c274a40bcc4c96fd9781139" candidate_uuid: "68a5669a4fbd4de6b4800d6ce778b416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d632ced116294bc1b7d25c33509a78c6"
I20260807 00:35:13.989099 13548 raft_consensus.cc:3037] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:13.989837 13410 raft_consensus.cc:2454] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68a5669a4fbd4de6b4800d6ce778b416 in term 1.
I20260807 00:35:13.990036 13548 raft_consensus.cc:2454] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68a5669a4fbd4de6b4800d6ce778b416 in term 1.
I20260807 00:35:13.990057 13205 leader_election.cc:302] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68a5669a4fbd4de6b4800d6ce778b416, fbe857dea90442b6ace728f73e454115; no voters:
I20260807 00:35:13.990190 13618 raft_consensus.cc:2781] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:13.990386 13618 raft_consensus.cc:686] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [term 1 LEADER]: Becoming Leader. State: Replica: 68a5669a4fbd4de6b4800d6ce778b416, State: Running, Role: LEADER
I20260807 00:35:13.990499 13618 consensus_queue.cc:237] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } }
I20260807 00:35:13.991484 13124 catalog_manager.cc:5495] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68a5669a4fbd4de6b4800d6ce778b416 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "68a5669a4fbd4de6b4800d6ce778b416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68a5669a4fbd4de6b4800d6ce778b416" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 38059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:14.013295 13609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.011940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44482 (local address 127.7.252.1:38059)
0807 00:35:14.012015 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.012017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.012028 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:14.012112 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.012113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.012138 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.012292 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:14.012923 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:14.012925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:14.012925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:14.012930 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:14.012948 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:14.012952 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:14.013036 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:14.013114 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 00:35:14.013131 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 00:35:14.015564 13410 raft_consensus.cc:1261] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 1 FOLLOWER]: Refusing update from remote peer 68a5669a4fbd4de6b4800d6ce778b416: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:14.015563 13548 raft_consensus.cc:1261] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 1 FOLLOWER]: Refusing update from remote peer 68a5669a4fbd4de6b4800d6ce778b416: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:14.015965 13618 consensus_queue.cc:1035] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d632ced116294bc1b7d25c33509a78c6" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 42485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:14.016156 13621 consensus_queue.cc:1035] T 3dd984d92c274a40bcc4c96fd9781139 P 68a5669a4fbd4de6b4800d6ce778b416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe857dea90442b6ace728f73e454115" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:14.019727 13624 mvcc.cc:205] Tried to move back new op lower bound from 7315713695804481536 to 7315713695705894912. Current Snapshot: MvccSnapshot[applied={T|T < 7315713695804481536}]
I20260807 00:35:14.019972 13627 mvcc.cc:205] Tried to move back new op lower bound from 7315713695804481536 to 7315713695705894912. Current Snapshot: MvccSnapshot[applied={T|T < 7315713695804481536}]
I20260807 00:35:14.020617 13628 mvcc.cc:205] Tried to move back new op lower bound from 7315713695804481536 to 7315713695705894912. Current Snapshot: MvccSnapshot[applied={T|T < 7315713695804481536 or (T in {7315713695804481536})}]
I20260807 00:35:14.022439 13124 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:14.022524 13124 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:14.023432 13124 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bd0aef7f87d47cf96d903b98e4525c2: Sending DeleteTablet for 3 replicas of tablet 3dd984d92c274a40bcc4c96fd9781139
I20260807 00:35:14.023736 13252 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dd984d92c274a40bcc4c96fd9781139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:14 UTC) from {username='slave'} at 127.0.0.1:44468
I20260807 00:35:14.023804 13528 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dd984d92c274a40bcc4c96fd9781139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:14 UTC) from {username='slave'} at 127.0.0.1:37530
I20260807 00:35:14.023903 13388 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dd984d92c274a40bcc4c96fd9781139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:14 UTC) from {username='slave'} at 127.0.0.1:39084
I20260807 00:35:14.024032 13638 tablet_replica.cc:330] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: stopping tablet replica
I20260807 00:35:14.024132 13638 raft_consensus.cc:2229] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:14.024161 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13189
I20260807 00:35:14.024245 13638 raft_consensus.cc:2258] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:14.025324 13639 tablet_replica.cc:330] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: stopping tablet replica
I20260807 00:35:14.025439 13639 raft_consensus.cc:2229] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:14.025542 13639 raft_consensus.cc:2258] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:14.026108 13639 ts_tablet_manager.cc:1905] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:14.026109 13638 ts_tablet_manager.cc:1905] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:14.028273 13639 ts_tablet_manager.cc:1918] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:14.028371 13639 log.cc:1196] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/3dd984d92c274a40bcc4c96fd9781139
I20260807 00:35:14.028405 13638 ts_tablet_manager.cc:1918] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:14.028506 13638 log.cc:1196] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/3dd984d92c274a40bcc4c96fd9781139
I20260807 00:35:14.028635 13639 ts_tablet_manager.cc:1939] T 3dd984d92c274a40bcc4c96fd9781139 P fbe857dea90442b6ace728f73e454115: Deleting consensus metadata
I20260807 00:35:14.028872 13638 ts_tablet_manager.cc:1939] T 3dd984d92c274a40bcc4c96fd9781139 P d632ced116294bc1b7d25c33509a78c6: Deleting consensus metadata
I20260807 00:35:14.029443 13109 catalog_manager.cc:4841] TS fbe857dea90442b6ace728f73e454115 (127.7.252.2:42889): tablet 3dd984d92c274a40bcc4c96fd9781139 (table test-table [id=85d489afbd7e475a9e5e1327de52653c]) successfully deleted
I20260807 00:35:14.030102 13111 catalog_manager.cc:4841] TS d632ced116294bc1b7d25c33509a78c6 (127.7.252.3:42485): tablet 3dd984d92c274a40bcc4c96fd9781139 (table test-table [id=85d489afbd7e475a9e5e1327de52653c]) successfully deleted
W20260807 00:35:14.032027 13110 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:38059 (error 108)
I20260807 00:35:14.032354 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13324
I20260807 00:35:14.033456 13605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.032470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:38059 (local address 127.0.0.1:44486)
0807 00:35:14.033352 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:14.033411 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:38059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":854}
W20260807 00:35:14.033630 13110 catalog_manager.cc:4584] TS 68a5669a4fbd4de6b4800d6ce778b416 (127.7.252.1:38059): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3dd984d92c274a40bcc4c96fd9781139: Network error: Client connection negotiation failed: client connection to 127.7.252.1:38059: connect: Connection refused (error 111)
I20260807 00:35:14.039017 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13463
I20260807 00:35:14.046995 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13092
2026-08-07T00:35:14Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (765 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 00:35:14.069623 8176 mini_oidc.cc:152] Starting JWKS server
I20260807 00:35:14.071084 8176 webserver.cc:460] Webserver started at https://127.0.0.1:37655/ using document root <none> and password file <none>
I20260807 00:35:14.071219 8176 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 00:35:14.071419 8176 webserver.cc:460] Webserver started at http://127.0.0.1:37959/ using document root <none> and password file <none>
2026-08-07T00:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:14Z Disabled control of system clock
I20260807 00:35:14.081120 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41969
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:40175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41969
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37655/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/testchainca.cert with env {}
W20260807 00:35:14.165798 13646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:14.166028 13646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:14.166054 13646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:14.167428 13646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:14.167507 13646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:14.167526 13646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:14.167548 13646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:14.167572 13646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 00:35:14.167601 13646 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 00:35:14.167621 13646 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37655/jwks.json
I20260807 00:35:14.169307 13646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41969
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37655/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:14.169588 13646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:14.169853 13646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:14.175480 13652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.175483 13651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.175592 13654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:14.175817 13646 server_base.cc:1034] running on GCE node
I20260807 00:35:14.176090 13646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:14.176435 13646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:14.177614 13646 hybrid_clock.cc:648] HybridClock initialized: now 1786062914177602 us; error 49 us; skew 500 ppm
I20260807 00:35:14.179107 13646 webserver.cc:460] Webserver started at http://127.7.252.62:34989/ using document root <none> and password file <none>
I20260807 00:35:14.179401 13646 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:14.179478 13646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:14.179641 13646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:14.180949 13646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "fcc6f035fc414f36bee94060e886cd1d"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "1f1d753452eb0d755af311e6db0b3c34"
server_key_iv: "1ccf844398e37cd06a38a19ad0d2a269"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.181418 13646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "fcc6f035fc414f36bee94060e886cd1d"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "1f1d753452eb0d755af311e6db0b3c34"
server_key_iv: "1ccf844398e37cd06a38a19ad0d2a269"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.183001 13646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260807 00:35:14.184000 13660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:14.184397 13646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:14.184516 13646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "fcc6f035fc414f36bee94060e886cd1d"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "1f1d753452eb0d755af311e6db0b3c34"
server_key_iv: "1ccf844398e37cd06a38a19ad0d2a269"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.184600 13646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:14.197099 13646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:14.197476 13646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:14.197642 13646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:14.202039 13646 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41969
I20260807 00:35:14.202105 13714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41969 every 8 connection(s)
I20260807 00:35:14.202502 13646 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:14.203734 13715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:14.206408 13715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d: Bootstrap starting.
I20260807 00:35:14.206610 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13646
I20260807 00:35:14.206751 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:14.206960 8176 external_mini_cluster.cc:1428] Setting key 35375f1e78c1275f70d93bccf121161e
I20260807 00:35:14.207345 13715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:14.207813 13715 log.cc:824] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:14.208701 13715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d: No bootstrap required, opened a new log
I20260807 00:35:14.211407 13715 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc6f035fc414f36bee94060e886cd1d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41969 } }
I20260807 00:35:14.211614 13715 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:14.211668 13715 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcc6f035fc414f36bee94060e886cd1d, State: Initialized, Role: FOLLOWER
I20260807 00:35:14.211812 13715 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc6f035fc414f36bee94060e886cd1d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41969 } }
I20260807 00:35:14.211896 13715 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:14.211930 13715 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:14.211971 13715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:14.212842 13715 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc6f035fc414f36bee94060e886cd1d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41969 } }
I20260807 00:35:14.212944 13715 leader_election.cc:302] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcc6f035fc414f36bee94060e886cd1d; no voters:
I20260807 00:35:14.213181 13715 leader_election.cc:288] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:14.213240 13720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:14.213371 13720 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [term 1 LEADER]: Becoming Leader. State: Replica: fcc6f035fc414f36bee94060e886cd1d, State: Running, Role: LEADER
I20260807 00:35:14.213481 13720 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc6f035fc414f36bee94060e886cd1d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41969 } }
I20260807 00:35:14.213521 13715 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:14.213865 13721 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcc6f035fc414f36bee94060e886cd1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc6f035fc414f36bee94060e886cd1d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41969 } } }
I20260807 00:35:14.213959 13721 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.214242 13722 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcc6f035fc414f36bee94060e886cd1d. Latest consensus state: current_term: 1 leader_uuid: "fcc6f035fc414f36bee94060e886cd1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc6f035fc414f36bee94060e886cd1d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41969 } } }
I20260807 00:35:14.214403 13722 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.214423 13718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.207545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33682 (local address 127.7.252.62:41969)
0807 00:35:14.207836 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.207847 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.207887 (+ 40us) server_negotiation.cc:407] Connection header received
0807 00:35:14.208589 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.208599 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.208687 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.208886 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:14.209133 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.210720 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.211615 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.212326 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.212469 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.213361 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:14.213366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:14.213366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:14.213607 (+ 241us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:14.213655 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:14.213672 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:14.213713 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:14.213853 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 00:35:14.213942 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":99,"threads_started":1}
I20260807 00:35:14.214213 13726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:14.215236 13726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:14.215752 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:35:14.217303 13726 catalog_manager.cc:1347] Generated new cluster ID: f4180b1c14324ba995935f0250063a3f
I20260807 00:35:14.217367 13726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:14.225446 13726 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:14.226056 13726 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:14.231856 13726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcc6f035fc414f36bee94060e886cd1d: Generated new TSK 0
I20260807 00:35:14.232067 13726 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 00:35:14.259509 13746 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 00:35:14.259825 13746 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 00:35:14.259974 13718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.242996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33688 (local address 127.7.252.62:41969)
0807 00:35:14.243046 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.243048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.243169 (+ 121us) server_negotiation.cc:407] Connection header received
0807 00:35:14.243250 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.243251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.243268 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.243357 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0807 00:35:14.243577 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.244422 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.245384 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.245723 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.245899 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.246122 (+ 223us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 00:35:14.259623 (+ 13501us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 00:35:14.259889 (+ 266us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33688: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":28}
W20260807 00:35:14.260061 13718 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33688: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 00:35:14.260799 13745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:14.242895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41969 (local address 127.0.0.1:33688)
0807 00:35:14.243097 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:14.243107 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:14.243170 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:14.243418 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:14.243420 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:14.243422 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 00:35:14.243493 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.243495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.244546 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.244547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.245288 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.245292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.245879 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.245880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.245940 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.245968 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 00:35:14.260372 (+ 14404us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 00:35:14.260511 (+ 139us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.252.62:41969: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":109,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.7.252.62:41969: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 00:35:14.261296 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13646
2026-08-07T00:35:14Z chronyd exiting
I20260807 00:35:14.299521 8176 test_util.cc:175] -----------------------------------------------
I20260807 00:35:14.299615 8176 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786062890064039-8176-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (231 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 00:35:14.300455 8176 mini_oidc.cc:152] Starting JWKS server
I20260807 00:35:14.301191 8176 webserver.cc:460] Webserver started at https://127.0.0.1:46733/ using document root <none> and password file <none>
I20260807 00:35:14.301237 8176 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 00:35:14.301407 8176 webserver.cc:460] Webserver started at http://127.0.0.1:46075/ using document root <none> and password file <none>
2026-08-07T00:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:14Z Disabled control of system clock
I20260807 00:35:14.311036 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:43103
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:37305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:43103
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46733/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/testchainca.cert with env {}
W20260807 00:35:14.401703 13752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:14.401965 13752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:14.402004 13752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:14.403293 13752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:14.403368 13752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:14.403393 13752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:14.403421 13752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:14.403470 13752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 00:35:14.403503 13752 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 00:35:14.403530 13752 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46733/jwks.json
I20260807 00:35:14.405157 13752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:43103
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:43103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46733/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:14.405473 13752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:14.405757 13752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:14.411278 13758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.411324 13757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.411327 13761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:14.411535 13752 server_base.cc:1034] running on GCE node
I20260807 00:35:14.411809 13752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:14.412139 13752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:14.413494 13752 hybrid_clock.cc:648] HybridClock initialized: now 1786062914413284 us; error 51 us; skew 500 ppm
I20260807 00:35:14.415025 13752 webserver.cc:460] Webserver started at http://127.7.252.62:41429/ using document root <none> and password file <none>
I20260807 00:35:14.415398 13752 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:14.415457 13752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:14.415611 13752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:14.416769 13752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "f6560d704c0e41b9bb0ccfc53b8e19be"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "391be263847c138c75e023336ec185ba"
server_key_iv: "186595a1519c5a1f8a7c156356a73d49"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.417171 13752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "f6560d704c0e41b9bb0ccfc53b8e19be"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "391be263847c138c75e023336ec185ba"
server_key_iv: "186595a1519c5a1f8a7c156356a73d49"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.418776 13752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:14.419814 13767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:14.420042 13752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:14.420156 13752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "f6560d704c0e41b9bb0ccfc53b8e19be"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "391be263847c138c75e023336ec185ba"
server_key_iv: "186595a1519c5a1f8a7c156356a73d49"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.420358 13752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:14.436262 13752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:14.436671 13752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:14.436858 13752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:14.441488 13752 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:43103
I20260807 00:35:14.441527 13823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:43103 every 8 connection(s)
I20260807 00:35:14.441947 13752 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:14.443068 13824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:14.445464 13824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be: Bootstrap starting.
I20260807 00:35:14.446033 13824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:14.446274 13824 log.cc:824] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:14.446328 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13752
I20260807 00:35:14.446444 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:14.446640 8176 external_mini_cluster.cc:1428] Setting key 1331c849ae5639a65fca091944ebaf90
I20260807 00:35:14.447194 13824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be: No bootstrap required, opened a new log
I20260807 00:35:14.449013 13824 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43103 } }
I20260807 00:35:14.449184 13824 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:14.449249 13824 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6560d704c0e41b9bb0ccfc53b8e19be, State: Initialized, Role: FOLLOWER
I20260807 00:35:14.449434 13824 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43103 } }
I20260807 00:35:14.449538 13824 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:14.449580 13824 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:14.449648 13824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:14.450232 13824 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43103 } }
I20260807 00:35:14.450366 13824 leader_election.cc:302] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6560d704c0e41b9bb0ccfc53b8e19be; no voters:
I20260807 00:35:14.450536 13824 leader_election.cc:288] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:14.450577 13829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:14.450752 13829 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [term 1 LEADER]: Becoming Leader. State: Replica: f6560d704c0e41b9bb0ccfc53b8e19be, State: Running, Role: LEADER
I20260807 00:35:14.450834 13824 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:14.450850 13829 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43103 } }
I20260807 00:35:14.451179 13830 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43103 } } }
I20260807 00:35:14.451277 13830 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.451182 13829 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6560d704c0e41b9bb0ccfc53b8e19be. Latest consensus state: current_term: 1 leader_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6560d704c0e41b9bb0ccfc53b8e19be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43103 } } }
I20260807 00:35:14.451572 13829 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.452450 13835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:14.453014 13835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:14.454870 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.447385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49866 (local address 127.7.252.62:43103)
0807 00:35:14.447636 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.447644 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.447675 (+ 31us) server_negotiation.cc:407] Connection header received
0807 00:35:14.449024 (+ 1349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.449032 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.449112 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.449340 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:14.449580 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.451293 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.452443 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.453087 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.453278 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.454083 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:14.454086 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:14.454087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:14.454310 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:14.454352 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:14.454367 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:14.454439 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:14.454532 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 00:35:14.454622 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":106,"threads_started":1}
I20260807 00:35:14.455112 13835 catalog_manager.cc:1347] Generated new cluster ID: e1385594ed564cbb92490cffdb13c8e5
I20260807 00:35:14.455164 13835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:14.455922 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:35:14.470063 13835 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:14.470747 13835 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:14.478216 13835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6560d704c0e41b9bb0ccfc53b8e19be: Generated new TSK 0
I20260807 00:35:14.478452 13835 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 00:35:14.507851 13854 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 00:35:14.507948 13854 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 00:35:14.508332 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.486042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.7.252.62:43103)
0807 00:35:14.486097 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.486099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.486135 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:35:14.486234 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.486235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.486249 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.486338 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0807 00:35:14.486499 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.487088 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.487905 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.488124 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.488202 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.488403 (+ 201us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 00:35:14.508037 (+ 19634us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46733/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 00:35:14.508235 (+ 198us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49878: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46733/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":28}
W20260807 00:35:14.508417 13828 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49878: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46733/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 00:35:14.508522 13853 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:14.485928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43103 (local address 127.0.0.1:49878)
0807 00:35:14.486059 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:14.486087 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:14.486156 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:14.486350 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:14.486351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:14.486353 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 00:35:14.486417 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.486419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.487178 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.487179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.487795 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.487798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.488203 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.488204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.488278 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.488284 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 00:35:14.508185 (+ 19901us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46733/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 00:35:14.508408 (+ 223us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.252.62:43103: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46733/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
I20260807 00:35:14.508836 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13752
2026-08-07T00:35:14Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (248 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 00:35:14.548629 8176 mini_oidc.cc:152] Starting JWKS server
I20260807 00:35:14.549383 8176 webserver.cc:460] Webserver started at https://127.0.0.1:42065/ using document root <none> and password file <none>
I20260807 00:35:14.549461 8176 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 00:35:14.549642 8176 webserver.cc:460] Webserver started at http://127.0.0.1:37329/ using document root <none> and password file <none>
2026-08-07T00:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:14Z Disabled control of system clock
I20260807 00:35:14.559296 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:38135
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:38135
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42065/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 00:35:14.642648 13860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:14.642958 13860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:14.642997 13860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:14.644245 13860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:14.644325 13860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:14.644347 13860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:14.644371 13860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:14.644399 13860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 00:35:14.644423 13860 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 00:35:14.644448 13860 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42065/jwks.json
I20260807 00:35:14.645869 13860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:38135
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:38135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42065/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:14.646162 13860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:14.646471 13860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:14.652053 13868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.652047 13866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.652045 13865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:14.652082 13860 server_base.cc:1034] running on GCE node
I20260807 00:35:14.652628 13860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:14.653033 13860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:14.654387 13860 hybrid_clock.cc:648] HybridClock initialized: now 1786062914654361 us; error 41 us; skew 500 ppm
I20260807 00:35:14.655898 13860 webserver.cc:460] Webserver started at http://127.7.252.62:44171/ using document root <none> and password file <none>
I20260807 00:35:14.656167 13860 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:14.656241 13860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:14.656435 13860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:14.657577 13860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "e221089ef1d9b2fcdb97cfc65726fe72"
server_key_iv: "e956e94368e2d9565fb978dddd21059d"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.657991 13860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "e221089ef1d9b2fcdb97cfc65726fe72"
server_key_iv: "e956e94368e2d9565fb978dddd21059d"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.659690 13860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 00:35:14.660593 13874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:14.660801 13860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:14.660909 13860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "e221089ef1d9b2fcdb97cfc65726fe72"
server_key_iv: "e956e94368e2d9565fb978dddd21059d"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.661008 13860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:14.681142 13860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:14.681529 13860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:14.681702 13860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:14.686313 13860 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:38135
I20260807 00:35:14.686370 13928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:38135 every 8 connection(s)
I20260807 00:35:14.686793 13860 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:14.687614 13929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:14.690793 13929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c: Bootstrap starting.
I20260807 00:35:14.691444 13929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:14.691758 13929 log.cc:824] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:14.692586 13929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c: No bootstrap required, opened a new log
I20260807 00:35:14.694373 13929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 38135 } }
I20260807 00:35:14.694521 13929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:14.694543 13929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f703812f6214d75a2e9b9c9e6f8dd1c, State: Initialized, Role: FOLLOWER
I20260807 00:35:14.694746 13929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 38135 } }
I20260807 00:35:14.694839 13929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:14.694864 13929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:14.694895 13929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:14.694885 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13860
I20260807 00:35:14.694976 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:14.695106 8176 external_mini_cluster.cc:1428] Setting key c80b22b4dbf398d6f1bde5ec7d0cd458
I20260807 00:35:14.695484 13929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 38135 } }
I20260807 00:35:14.695600 13929 leader_election.cc:302] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f703812f6214d75a2e9b9c9e6f8dd1c; no voters:
I20260807 00:35:14.695804 13929 leader_election.cc:288] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:14.695910 13933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:14.696087 13929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:14.696086 13933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [term 1 LEADER]: Becoming Leader. State: Replica: 3f703812f6214d75a2e9b9c9e6f8dd1c, State: Running, Role: LEADER
I20260807 00:35:14.696262 13933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 38135 } }
I20260807 00:35:14.697091 13936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f703812f6214d75a2e9b9c9e6f8dd1c. Latest consensus state: current_term: 1 leader_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 38135 } } }
I20260807 00:35:14.697280 13935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f703812f6214d75a2e9b9c9e6f8dd1c" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 38135 } } }
I20260807 00:35:14.697191 13936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.697368 13935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.697633 13941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:14.698202 13941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:14.699999 13941 catalog_manager.cc:1347] Generated new cluster ID: 8a031d56be0345aca840393448b411b9
I20260807 00:35:14.700059 13941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:14.701963 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.695710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.7.252.62:38135)
0807 00:35:14.695964 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.695974 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.696017 (+ 43us) server_negotiation.cc:407] Connection header received
0807 00:35:14.696319 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.696327 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.696416 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.696540 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:14.697017 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.698573 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.699777 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.700369 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.700507 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.701248 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:14.701253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:14.701253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:14.701447 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:14.701480 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:14.701491 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:14.701568 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:14.701651 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 00:35:14.701742 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260807 00:35:14.703773 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:35:14.712611 13941 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:14.713312 13941 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:14.720633 13941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f703812f6214d75a2e9b9c9e6f8dd1c: Generated new TSK 0
I20260807 00:35:14.720916 13941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:14.733234 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.728671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48826 (local address 127.7.252.62:38135)
0807 00:35:14.728718 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.728720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.728891 (+ 171us) server_negotiation.cc:407] Connection header received
0807 00:35:14.728929 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.728930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.728941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.729017 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0807 00:35:14.729295 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.729800 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.731083 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.731391 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.731466 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.731737 (+ 271us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 00:35:14.732993 (+ 1256us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42065/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 00:35:14.733143 (+ 150us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48826: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42065/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 00:35:14.733350 13960 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:14.728556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:38135 (local address 127.0.0.1:48826)
0807 00:35:14.728726 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:14.728739 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:14.728817 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:14.729037 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:14.729038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:14.729040 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 00:35:14.729114 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.729117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.729914 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.729916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.730952 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.730958 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.731495 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.731496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.731570 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.731578 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 00:35:14.733115 (+ 1537us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42065/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 00:35:14.733237 (+ 122us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.252.62:38135: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42065/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260807 00:35:14.733543 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13860
E20260807 00:35:14.746389 13962 webserver.cc:533] Webserver: sslize failed:
E20260807 00:35:14.746511 13962 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T00:35:14Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (227 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T00:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:14Z Disabled control of system clock
I20260807 00:35:14.786068 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:42601
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:37859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:42601
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/testchainca.cert with env {}
W20260807 00:35:14.877383 13966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:14.877640 13966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:14.877671 13966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:14.879130 13966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:14.879181 13966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:14.879196 13966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:14.879217 13966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:14.879232 13966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 00:35:14.879246 13966 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 00:35:14.879259 13966 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 00:35:14.881119 13966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:42601
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:42601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:14.881376 13966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:14.881572 13966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:14.887621 13972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:14.887601 13971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:14.887639 13966 server_base.cc:1034] running on GCE node
W20260807 00:35:14.887584 13974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:14.888191 13966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:14.888535 13966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:14.889745 13966 hybrid_clock.cc:648] HybridClock initialized: now 1786062914889730 us; error 51 us; skew 500 ppm
I20260807 00:35:14.891202 13966 webserver.cc:460] Webserver started at http://127.7.252.62:41613/ using document root <none> and password file <none>
I20260807 00:35:14.891499 13966 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:14.891577 13966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:14.891737 13966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:14.892870 13966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "4611dfb463f74b41b2b951dca7322501"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "233285d78746be784807329a64f82017"
server_key_iv: "5fe4e4e9481c12fe7ca5763c1a646363"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.893240 13966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "4611dfb463f74b41b2b951dca7322501"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "233285d78746be784807329a64f82017"
server_key_iv: "5fe4e4e9481c12fe7ca5763c1a646363"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.894780 13966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:35:14.895690 13980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:14.896006 13966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:14.896123 13966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "4611dfb463f74b41b2b951dca7322501"
format_stamp: "Formatted at 2026-08-07 00:35:14 on dist-test-slave-csg5"
server_key: "233285d78746be784807329a64f82017"
server_key_iv: "5fe4e4e9481c12fe7ca5763c1a646363"
server_key_version: "encryptionkey@0"
I20260807 00:35:14.896216 13966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:14.917347 13966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:14.917735 13966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:14.917923 13966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:14.922765 13966 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:42601
I20260807 00:35:14.922851 14033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:42601 every 8 connection(s)
I20260807 00:35:14.923245 13966 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:14.924340 14034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:14.927207 14034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501: Bootstrap starting.
I20260807 00:35:14.927946 14034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:14.928306 14034 log.cc:824] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:14.929191 14034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501: No bootstrap required, opened a new log
I20260807 00:35:14.931337 14034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4611dfb463f74b41b2b951dca7322501" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42601 } }
I20260807 00:35:14.931512 14034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:14.931538 14034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4611dfb463f74b41b2b951dca7322501, State: Initialized, Role: FOLLOWER
I20260807 00:35:14.931764 14034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4611dfb463f74b41b2b951dca7322501" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42601 } }
I20260807 00:35:14.931895 14034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:14.931939 14034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:14.931943 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 13966
I20260807 00:35:14.932008 14034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:14.932065 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:14.932286 8176 external_mini_cluster.cc:1428] Setting key 0918affdad6c9452622d18b04ed20a3d
I20260807 00:35:14.932941 14034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4611dfb463f74b41b2b951dca7322501" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42601 } }
I20260807 00:35:14.933073 14034 leader_election.cc:302] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4611dfb463f74b41b2b951dca7322501; no voters:
I20260807 00:35:14.933247 14034 leader_election.cc:288] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:14.933344 14039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:14.933504 14039 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [term 1 LEADER]: Becoming Leader. State: Replica: 4611dfb463f74b41b2b951dca7322501, State: Running, Role: LEADER
I20260807 00:35:14.933626 14034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:14.933636 14039 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4611dfb463f74b41b2b951dca7322501" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42601 } }
I20260807 00:35:14.934047 14041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4611dfb463f74b41b2b951dca7322501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4611dfb463f74b41b2b951dca7322501" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42601 } } }
I20260807 00:35:14.934155 14041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.934039 14039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4611dfb463f74b41b2b951dca7322501. Latest consensus state: current_term: 1 leader_uuid: "4611dfb463f74b41b2b951dca7322501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4611dfb463f74b41b2b951dca7322501" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 42601 } } }
I20260807 00:35:14.934567 14039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:14.934705 14046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:14.935374 14046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:14.937387 14046 catalog_manager.cc:1347] Generated new cluster ID: c31cb84f3a244a8baa4c8690e64a3a6b
I20260807 00:35:14.937500 14046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:14.941236 14038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.932898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53536 (local address 127.7.252.62:42601)
0807 00:35:14.933200 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.933212 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.933254 (+ 42us) server_negotiation.cc:407] Connection header received
0807 00:35:14.933417 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.933426 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.933514 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.934002 (+ 488us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:14.934110 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.937022 (+ 2912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.938335 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.939090 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.939663 (+ 573us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.940132 (+ 469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:14.940137 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:14.940137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:14.940381 (+ 244us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:14.940429 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:14.940446 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:14.940833 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:14.940875 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 00:35:14.940971 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":115,"threads_started":1}
I20260807 00:35:14.942425 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:35:14.958854 14046 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:14.959472 14046 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:14.968278 14046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4611dfb463f74b41b2b951dca7322501: Generated new TSK 0
I20260807 00:35:14.968546 14046 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:14.995936 14038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:14.975955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53538 (local address 127.7.252.62:42601)
0807 00:35:14.976022 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:14.976024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:14.976141 (+ 117us) server_negotiation.cc:407] Connection header received
0807 00:35:14.976292 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:14.976294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:14.976309 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:14.976403 (+ 94us) server_negotiation.cc:226] Negotiated authn=JWT
0807 00:35:14.976602 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.977464 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.978307 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.978637 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.978741 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.978985 (+ 244us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 00:35:14.995617 (+ 16632us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 00:35:14.995852 (+ 235us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53538: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 00:35:14.996023 14038 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53538: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 00:35:14.996071 14065 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:14.975815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:42601 (local address 127.0.0.1:53538)
0807 00:35:14.976065 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:14.976076 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:14.976142 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:14.976449 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:14.976450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:14.976452 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 00:35:14.976517 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.976519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.977564 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.977565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.978211 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:14.978214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:14.978792 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:14.978794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:14.978849 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:14.978856 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 00:35:14.995808 (+ 16952us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 00:35:14.995939 (+ 131us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.252.62:42601: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":155,"threads_started":1}
I20260807 00:35:14.996440 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 13966
2026-08-07T00:35:14Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (239 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (103 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (97 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:15 dist-test-slave-csg5 krb5kdc[14078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:15 dist-test-slave-csg5 krb5kdc[14078](info): set up 2 sockets
Aug 07 00:35:15 dist-test-slave-csg5 krb5kdc[14078](info): commencing operation
krb5kdc: starting...
W20260807 00:35:16.328661 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:16 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:16.486088 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:33549
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:37591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:33549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:16.576153 14091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:16.576452 14091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:16.576499 14091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:16.577912 14091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:16.578001 14091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:16.578033 14091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:16.578070 14091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:16.578095 14091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:16.579959 14091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:33549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:33549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:16.580303 14091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:16.580585 14091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:16.586364 14099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:16.586354 14096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:16.586354 14097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:16.586535 14091 server_base.cc:1034] running on GCE node
I20260807 00:35:16.586974 14091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:16.587273 14091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:16.588470 14091 hybrid_clock.cc:648] HybridClock initialized: now 1786062916588454 us; error 37 us; skew 500 ppm
Aug 07 00:35:16 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062916, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:16.591444 14091 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:16.592018 14091 webserver.cc:460] Webserver started at http://127.7.252.62:35537/ using document root <none> and password file <none>
I20260807 00:35:16.592291 14091 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:16.592347 14091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:16.592521 14091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:16.593750 14091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "23e74c701bfc4e599ee1bce6d5ccc971"
format_stamp: "Formatted at 2026-08-07 00:35:16 on dist-test-slave-csg5"
server_key: "aec60d90072d0a40ec09dea008668836"
server_key_iv: "e0de1c5a412d96ba57edafc736a2120b"
server_key_version: "encryptionkey@0"
I20260807 00:35:16.594132 14091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "23e74c701bfc4e599ee1bce6d5ccc971"
format_stamp: "Formatted at 2026-08-07 00:35:16 on dist-test-slave-csg5"
server_key: "aec60d90072d0a40ec09dea008668836"
server_key_iv: "e0de1c5a412d96ba57edafc736a2120b"
server_key_version: "encryptionkey@0"
I20260807 00:35:16.595700 14091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:16.596674 14106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:16.597050 14091 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:16.597167 14091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "23e74c701bfc4e599ee1bce6d5ccc971"
format_stamp: "Formatted at 2026-08-07 00:35:16 on dist-test-slave-csg5"
server_key: "aec60d90072d0a40ec09dea008668836"
server_key_iv: "e0de1c5a412d96ba57edafc736a2120b"
server_key_version: "encryptionkey@0"
I20260807 00:35:16.597247 14091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:16.619930 14091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:16.622857 14091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:16.623085 14091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:16.628247 14091 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:33549
I20260807 00:35:16.628326 14159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:33549 every 8 connection(s)
I20260807 00:35:16.628752 14091 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:16.629892 14160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:16.632915 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14091
I20260807 00:35:16.633044 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:16.633266 8176 external_mini_cluster.cc:1428] Setting key 84ec27ba2d07206ac623f48a224ca21c
I20260807 00:35:16.633337 14160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971: Bootstrap starting.
I20260807 00:35:16.634356 14160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:16.634796 14160 log.cc:824] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:16.635882 14160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971: No bootstrap required, opened a new log
I20260807 00:35:16.638425 14160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33549 } }
I20260807 00:35:16.638643 14160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:16.638707 14160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e74c701bfc4e599ee1bce6d5ccc971, State: Initialized, Role: FOLLOWER
I20260807 00:35:16.638837 14160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33549 } }
I20260807 00:35:16.638916 14160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:16.638947 14160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:16.638995 14160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:16.639784 14160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33549 } }
I20260807 00:35:16.639912 14160 leader_election.cc:302] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23e74c701bfc4e599ee1bce6d5ccc971; no voters:
I20260807 00:35:16.640131 14160 leader_election.cc:288] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:16.640208 14165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:16.640451 14165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [term 1 LEADER]: Becoming Leader. State: Replica: 23e74c701bfc4e599ee1bce6d5ccc971, State: Running, Role: LEADER
I20260807 00:35:16.640476 14160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:16.640637 14165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33549 } }
I20260807 00:35:16.641623 14166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33549 } } }
I20260807 00:35:16.641726 14166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:16.642206 14167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23e74c701bfc4e599ee1bce6d5ccc971. Latest consensus state: current_term: 1 leader_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e74c701bfc4e599ee1bce6d5ccc971" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33549 } } }
Aug 07 00:35:16 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:16.642350 14167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971 [sys.catalog]: This master's current role is: LEADER
W20260807 00:35:16.642794 14181 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:35:16.642863 14181 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:35:16.643006 14177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:16.643230 14177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:16.644984 14177 catalog_manager.cc:1347] Generated new cluster ID: 2587859a28734b2e85626c5e69283ee4
I20260807 00:35:16.645048 14177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:16.647357 14163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:16.633926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54174 (local address 127.7.252.62:33549)
0807 00:35:16.634187 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:16.634198 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:16.634239 (+ 41us) server_negotiation.cc:407] Connection header received
0807 00:35:16.634995 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:16.635005 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:16.635080 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:16.635231 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:16.636150 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:16.637603 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:16.638497 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:16.639160 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:16.639288 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:16.643067 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:16.643072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:16.643073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:16.643086 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:16.645403 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:16.645886 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:16.645890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:16.645890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:16.646015 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:16.646237 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:16.646238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:16.646239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:16.646588 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:16.646856 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:16.646936 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 00:35:16.647103 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":119,"threads_started":1}
I20260807 00:35:16.664927 14177 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:16.665594 14177 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:16.671398 14177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23e74c701bfc4e599ee1bce6d5ccc971: Generated new TSK 0
I20260807 00:35:16.671655 14177 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:16.714133 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33549
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:37591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:16.821573 14188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:16.821811 14188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:16.821839 14188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:16.823159 14188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:16.823217 14188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:16.823248 14188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:16.824827 14188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:16.825053 14188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:16.825284 14188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:16.831003 14193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:16.830976 14194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:16.830983 14196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:16.831132 14188 server_base.cc:1034] running on GCE node
I20260807 00:35:16.831528 14188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:16.831846 14188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:16.833051 14188 hybrid_clock.cc:648] HybridClock initialized: now 1786062916832964 us; error 97 us; skew 500 ppm
Aug 07 00:35:16 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062916, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:16.836495 14188 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:16.836979 14188 webserver.cc:460] Webserver started at http://127.7.252.1:40379/ using document root <none> and password file <none>
I20260807 00:35:16.837261 14188 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:16.837314 14188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:16.837469 14188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:16.838825 14188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "44f993cf08df427eafb98c74da779cc0"
format_stamp: "Formatted at 2026-08-07 00:35:16 on dist-test-slave-csg5"
server_key: "4c4aa91eb3e4c6eefcd84dc5e6dec2bf"
server_key_iv: "43307eaac9120f7caa053cabd1855c95"
server_key_version: "encryptionkey@0"
I20260807 00:35:16.839287 14188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "44f993cf08df427eafb98c74da779cc0"
format_stamp: "Formatted at 2026-08-07 00:35:16 on dist-test-slave-csg5"
server_key: "4c4aa91eb3e4c6eefcd84dc5e6dec2bf"
server_key_iv: "43307eaac9120f7caa053cabd1855c95"
server_key_version: "encryptionkey@0"
I20260807 00:35:16.841001 14188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:16.842222 14203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:16.842768 14188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:16.842864 14188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "44f993cf08df427eafb98c74da779cc0"
format_stamp: "Formatted at 2026-08-07 00:35:16 on dist-test-slave-csg5"
server_key: "4c4aa91eb3e4c6eefcd84dc5e6dec2bf"
server_key_iv: "43307eaac9120f7caa053cabd1855c95"
server_key_version: "encryptionkey@0"
I20260807 00:35:16.842974 14188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:16.860682 14188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:16.863413 14188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:16.863580 14188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:16.863929 14188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:16.864506 14188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:16.864583 14188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:16.864650 14188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:16.864711 14188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:16.872920 14188 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:35777
I20260807 00:35:16.872972 14320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:35777 every 8 connection(s)
I20260807 00:35:16.873368 14188 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:35:16 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062916, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:16.882715 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14188
I20260807 00:35:16.882887 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:16.883132 8176 external_mini_cluster.cc:1428] Setting key 6660833499ceecc4d6f267efccf4e895
I20260807 00:35:16.886538 14163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:16.874518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:59045 (local address 127.7.252.62:33549)
0807 00:35:16.874567 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:16.874569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:16.874582 (+ 13us) server_negotiation.cc:407] Connection header received
0807 00:35:16.875725 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:16.875726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:16.875738 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:16.875807 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:16.876668 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:16.877380 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:16.878496 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:16.878824 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:16.879004 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:16.881670 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:16.881672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:16.881672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:16.881681 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:16.884322 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:16.885048 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:16.885049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:16.885050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:16.885116 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:16.885528 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:16.885529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:16.885529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:16.885676 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:16.885770 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:16.886197 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 00:35:16.886287 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:16.886745 14323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:16.874241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33549 (local address 127.7.252.1:59045)
0807 00:35:16.874428 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:16.874478 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:16.875556 (+ 1078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:16.875949 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:16.875954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:16.876317 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:16.876558 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:16.876563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:16.877540 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:16.877541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:16.878391 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:16.878394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:16.879044 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:16.879045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:16.879167 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:16.879842 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:16.879851 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:16.881520 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:16.884433 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:16.884449 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:16.884454 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:16.884939 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:16.885217 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:16.885218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:16.885218 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:16.885416 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:16.885770 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:16.885778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:16.885998 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 00:35:16.886136 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 00:35:16.886373 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260807 00:35:16.887511 14321 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33549
I20260807 00:35:16.887714 14321 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:16.887949 14321 heartbeater.cc:511] Master 127.7.252.62:33549 requested a full tablet report, sending...
I20260807 00:35:16.888744 14124 ts_manager.cc:194] Registered new tserver with Master: 44f993cf08df427eafb98c74da779cc0 (127.7.252.1:35777)
I20260807 00:35:16.889612 14124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:59045
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:16.919175 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33549
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:37591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:17.011456 14326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:17.011693 14326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:17.011719 14326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:17.012949 14326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:17.013000 14326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:17.013028 14326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:17.014616 14326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:17.014922 14326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:17.015180 14326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:17.020959 14334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:17.020992 14332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:17.021148 14326 server_base.cc:1034] running on GCE node
W20260807 00:35:17.021005 14331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:17.021535 14326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:17.021764 14326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:17.022928 14326 hybrid_clock.cc:648] HybridClock initialized: now 1786062917022914 us; error 32 us; skew 500 ppm
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.026036 14326 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:17.026634 14326 webserver.cc:460] Webserver started at http://127.7.252.2:37585/ using document root <none> and password file <none>
I20260807 00:35:17.026985 14326 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:17.027058 14326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:17.027235 14326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:17.028395 14326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "a1ed0c037a324816a207fb810b0a56d3"
format_stamp: "Formatted at 2026-08-07 00:35:17 on dist-test-slave-csg5"
server_key: "cf0ddc2d67a73d3f1653227494a4f4fc"
server_key_iv: "2f61f1dc43d1f3d2e12166c52a160647"
server_key_version: "encryptionkey@0"
I20260807 00:35:17.028770 14326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "a1ed0c037a324816a207fb810b0a56d3"
format_stamp: "Formatted at 2026-08-07 00:35:17 on dist-test-slave-csg5"
server_key: "cf0ddc2d67a73d3f1653227494a4f4fc"
server_key_iv: "2f61f1dc43d1f3d2e12166c52a160647"
server_key_version: "encryptionkey@0"
I20260807 00:35:17.030313 14326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:17.031371 14341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:17.031653 14326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:17.031798 14326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "a1ed0c037a324816a207fb810b0a56d3"
format_stamp: "Formatted at 2026-08-07 00:35:17 on dist-test-slave-csg5"
server_key: "cf0ddc2d67a73d3f1653227494a4f4fc"
server_key_iv: "2f61f1dc43d1f3d2e12166c52a160647"
server_key_version: "encryptionkey@0"
I20260807 00:35:17.031899 14326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:17.041855 14326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:17.044579 14326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:17.044792 14326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:17.045065 14326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:17.045418 14326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:17.045475 14326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:17.045519 14326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:17.045549 14326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:17.053283 14326 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:44849
I20260807 00:35:17.053330 14458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:44849 every 8 connection(s)
I20260807 00:35:17.053756 14326 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:17.056000 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14326
I20260807 00:35:17.056154 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:17.056514 8176 external_mini_cluster.cc:1428] Setting key e527f6074d8d17153c79085ebe8eded6
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:17.067140 14163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.054844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:44725 (local address 127.7.252.62:33549)
0807 00:35:17.054917 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.054920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.055105 (+ 185us) server_negotiation.cc:407] Connection header received
0807 00:35:17.056132 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.056133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.056152 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.056220 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.057027 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.057772 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.059510 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.059886 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.059970 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.063232 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:17.063235 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:17.063235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:17.063245 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:17.065197 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.065843 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.065844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.065844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.065929 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.066286 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.066286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.066287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.066421 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:17.066480 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:17.066972 (+ 492us) server_negotiation.cc:299] Negotiation successful
0807 00:35:17.067060 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 00:35:17.067443 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.054715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33549 (local address 127.7.252.2:44725)
0807 00:35:17.054950 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:17.055001 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:17.056005 (+ 1004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:17.056302 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:17.056307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:17.056693 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:17.056914 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:17.056934 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.057886 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.057887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:17.059370 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:17.059374 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.060057 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.060059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:17.060238 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.060894 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:17.060906 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:17.063026 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:17.065317 (+ 2291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:17.065329 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:17.065332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:17.065739 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:17.066011 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:17.066012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:17.066012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:17.066195 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:17.066501 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:17.066509 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:17.066755 (+ 246us) client_negotiation.cc:769] Sending connection context
0807 00:35:17.066893 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 00:35:17.067117 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":129,"threads_started":1}
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:35:17.068077 14459 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33549
I20260807 00:35:17.068373 14459 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:17.068604 14459 heartbeater.cc:511] Master 127.7.252.62:33549 requested a full tablet report, sending...
I20260807 00:35:17.069264 14124 ts_manager.cc:194] Registered new tserver with Master: a1ed0c037a324816a207fb810b0a56d3 (127.7.252.2:44849)
I20260807 00:35:17.069871 14124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:44725
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:17.090823 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33549
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:37591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:17.192899 14464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:17.193210 14464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:17.193270 14464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:17.195035 14464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:17.195135 14464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:17.195199 14464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:17.197492 14464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:17.197844 14464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:17.198128 14464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:17.205632 14470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:17.205652 14464 server_base.cc:1034] running on GCE node
W20260807 00:35:17.205632 14472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:17.205638 14469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:17.206280 14464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:17.206588 14464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:17.207768 14464 hybrid_clock.cc:648] HybridClock initialized: now 1786062917207731 us; error 52 us; skew 500 ppm
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.211151 14464 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:17.211848 14464 webserver.cc:460] Webserver started at http://127.7.252.3:34109/ using document root <none> and password file <none>
I20260807 00:35:17.212153 14464 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:17.212236 14464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:17.212419 14464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:17.213785 14464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "67a3e1de33f645639e0f6c29cd05397b"
format_stamp: "Formatted at 2026-08-07 00:35:17 on dist-test-slave-csg5"
server_key: "7e8a1e90c9df3b914d4906018e90d312"
server_key_iv: "e7daaf45a4bd3953692d5e4d873b811b"
server_key_version: "encryptionkey@0"
I20260807 00:35:17.214218 14464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "67a3e1de33f645639e0f6c29cd05397b"
format_stamp: "Formatted at 2026-08-07 00:35:17 on dist-test-slave-csg5"
server_key: "7e8a1e90c9df3b914d4906018e90d312"
server_key_iv: "e7daaf45a4bd3953692d5e4d873b811b"
server_key_version: "encryptionkey@0"
I20260807 00:35:17.215991 14464 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 00:35:17.217149 14479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:17.217561 14464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:17.217705 14464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "67a3e1de33f645639e0f6c29cd05397b"
format_stamp: "Formatted at 2026-08-07 00:35:17 on dist-test-slave-csg5"
server_key: "7e8a1e90c9df3b914d4906018e90d312"
server_key_iv: "e7daaf45a4bd3953692d5e4d873b811b"
server_key_version: "encryptionkey@0"
I20260807 00:35:17.217795 14464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:17.236424 14464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:17.239794 14464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:17.240093 14464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:17.240413 14464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:17.240863 14464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:17.240922 14464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:17.240967 14464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:17.240994 14464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:17.249915 14464 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:41381
I20260807 00:35:17.250003 14596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:41381 every 8 connection(s)
I20260807 00:35:17.250396 14464 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:17.258279 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14464
I20260807 00:35:17.258378 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:17.258603 8176 external_mini_cluster.cc:1428] Setting key 54a034bae3f511bb67632c2ba4baf938
I20260807 00:35:17.263245 14163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.251441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:43525 (local address 127.7.252.62:33549)
0807 00:35:17.251659 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.251662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.251898 (+ 236us) server_negotiation.cc:407] Connection header received
0807 00:35:17.252931 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.252932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.252946 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.253003 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.253782 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.254308 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.255486 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.255703 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.255799 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.258716 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:17.258719 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:17.258719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:17.258811 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:17.261067 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.261746 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.261748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.261748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.261817 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.262181 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.262183 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.262183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.262397 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:17.262492 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:17.262957 (+ 465us) server_negotiation.cc:299] Negotiation successful
0807 00:35:17.263044 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 00:35:17.263389 14599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.251335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33549 (local address 127.7.252.3:43525)
0807 00:35:17.251708 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:17.251761 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:17.252792 (+ 1031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:17.253098 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:17.253110 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:17.253458 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:17.253664 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:17.253668 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.254428 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.254429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:17.255380 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:17.255383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.255816 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.255817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:17.255972 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.256610 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:17.256620 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:17.258498 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:17.261262 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:17.261274 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:17.261276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:17.261577 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:17.261942 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:17.261943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:17.261943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:17.262082 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:17.262514 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:17.262521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:17.262723 (+ 202us) client_negotiation.cc:769] Sending connection context
0807 00:35:17.262887 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 00:35:17.263051 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":123,"threads_started":1}
I20260807 00:35:17.264088 14597 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33549
I20260807 00:35:17.264214 14597 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:17.264454 14597 heartbeater.cc:511] Master 127.7.252.62:33549 requested a full tablet report, sending...
I20260807 00:35:17.265017 14124 ts_manager.cc:194] Registered new tserver with Master: 67a3e1de33f645639e0f6c29cd05397b (127.7.252.3:41381)
I20260807 00:35:17.265484 14124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:43525
I20260807 00:35:17.271152 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/test-admin.keytab.
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.292688 8176 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 00:35:17.294641 14604 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:17.293695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58100 (local address 127.7.252.1:35777)
0807 00:35:17.293883 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.293888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.293897 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:17.293922 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.293924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.293938 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.294026 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.294554 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58100: BlockingRecv error: recv got EOF from 127.0.0.1:58100 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":87,"threads_started":1}
W20260807 00:35:17.294734 8176 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc' of type FILE
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.296015 8176 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.297022 8176 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:35:17.306434 14604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.297669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.7.252.1:35777)
0807 00:35:17.297732 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.297734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.297744 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:17.297808 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.297809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.297821 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.297899 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.298341 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.299251 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.300047 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.300427 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.300510 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.303020 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:17.303035 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:17.303036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:17.303050 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:17.305029 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.305475 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.305479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.305480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.305549 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.305781 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.305782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.305782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.305956 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:17.306126 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:17.306218 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 00:35:17.306312 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 00:35:17.308861 14604 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:17.308124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58116 (local address 127.7.252.1:35777)
0807 00:35:17.308182 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.308184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.308200 (+ 16us) server_negotiation.cc:407] Connection header received
0807 00:35:17.308268 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.308269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.308281 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.308347 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.308801 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58116: BlockingRecv error: recv got EOF from 127.0.0.1:58116 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 00:35:17.308975 8176 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc' of type FILE
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.310212 8176 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.311546 8176 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:35:17.320480 14604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.312237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58118 (local address 127.7.252.1:35777)
0807 00:35:17.312311 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.312314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.312479 (+ 165us) server_negotiation.cc:407] Connection header received
0807 00:35:17.312589 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.312591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.312602 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.312695 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.313146 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.313718 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.314618 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.314938 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.315040 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.317605 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:17.317607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:17.317607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:17.317616 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:17.319224 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.319622 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.319624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.319624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.319691 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.319899 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.319900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.319901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.320014 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:17.320120 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:17.320271 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 00:35:17.320365 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 00:35:17.322528 14604 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:17.321806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58134 (local address 127.7.252.1:35777)
0807 00:35:17.321873 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.321875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.321883 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:17.321936 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.321936 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.321945 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.322009 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.322451 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58134: BlockingRecv error: recv got EOF from 127.0.0.1:58134 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 00:35:17.322567 8176 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786062890064039-8176-0/krb5kdc/krb5cc' of type FILE
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.323740 8176 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:17.324604 8176 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:35:17.332937 14604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:17.325195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.7.252.1:35777)
0807 00:35:17.325256 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:17.325258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:17.325304 (+ 46us) server_negotiation.cc:407] Connection header received
0807 00:35:17.325389 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:17.325390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:17.325399 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:17.325469 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:17.325902 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.326387 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.327155 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:17.327357 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:17.327444 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:17.329895 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:17.329897 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:17.329897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:17.329903 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:17.331456 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.331909 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.331910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.331910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.331979 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:17.332200 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:17.332202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:17.332202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:17.332319 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:17.332531 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:17.332723 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 00:35:17.332821 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 00:35:17.334110 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14188
I20260807 00:35:17.339993 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14326
I20260807 00:35:17.345405 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14464
I20260807 00:35:17.351619 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14091
2026-08-07T00:35:17Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2156 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14618](info): set up 2 sockets
Aug 07 00:35:17 dist-test-slave-csg5 krb5kdc[14618](info): commencing operation
krb5kdc: starting...
W20260807 00:35:18.500573 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:18 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:18Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab.
Entry for principal oryx/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab.
I20260807 00:35:18.642158 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44397
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab
--principal=oryx/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:18.734207 14631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:18.734499 14631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:18.734527 14631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:18.735893 14631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:18.735950 14631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:18.735966 14631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:18.735981 14631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:18.735996 14631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:18.737640 14631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab
--principal=oryx/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:18.737864 14631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:18.738051 14631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:18.743315 14637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:18.743285 14639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:18.743314 14636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:18.744028 14631 server_base.cc:1034] running on GCE node
I20260807 00:35:18.744300 14631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:18.744653 14631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:18.745820 14631 hybrid_clock.cc:648] HybridClock initialized: now 1786062918745797 us; error 43 us; skew 500 ppm
Aug 07 00:35:18 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:18.753563 14631 init.cc:377] Logged in from keytab as oryx/127.7.252.62@KRBTEST.COM (short username oryx)
I20260807 00:35:18.754135 14631 webserver.cc:460] Webserver started at http://127.7.252.62:43319/ using document root <none> and password file <none>
I20260807 00:35:18.754406 14631 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:18.754488 14631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:18.754710 14631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:18.755997 14631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "90f09e3a6c0f456f9ed288fa60bc13bb"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "c71d0cc5d01e17c0eb40e106c20dff69"
server_key_iv: "ac851e7373fb75f679f26ed89046ae74"
server_key_version: "encryptionkey@0"
I20260807 00:35:18.756419 14631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "90f09e3a6c0f456f9ed288fa60bc13bb"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "c71d0cc5d01e17c0eb40e106c20dff69"
server_key_iv: "ac851e7373fb75f679f26ed89046ae74"
server_key_version: "encryptionkey@0"
I20260807 00:35:18.757997 14631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:18.758880 14646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:18.759078 14631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:18.759197 14631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "90f09e3a6c0f456f9ed288fa60bc13bb"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "c71d0cc5d01e17c0eb40e106c20dff69"
server_key_iv: "ac851e7373fb75f679f26ed89046ae74"
server_key_version: "encryptionkey@0"
I20260807 00:35:18.759282 14631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:18.769316 14631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:18.771956 14631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:18.772140 14631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:18.776876 14631 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44397
I20260807 00:35:18.776928 14699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44397 every 8 connection(s)
I20260807 00:35:18.777339 14631 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:18.778220 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14631
I20260807 00:35:18.778367 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:18.778584 8176 external_mini_cluster.cc:1428] Setting key ed3726effa343deac16acb2ce827d543
I20260807 00:35:18.778636 14700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:18.781997 14700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Bootstrap starting.
I20260807 00:35:18.782759 14700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:18.783097 14700 log.cc:824] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:18.783907 14700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: No bootstrap required, opened a new log
Aug 07 00:35:18 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:18.786389 14700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } }
I20260807 00:35:18.786587 14700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:18.786641 14700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90f09e3a6c0f456f9ed288fa60bc13bb, State: Initialized, Role: FOLLOWER
I20260807 00:35:18.786872 14700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } }
I20260807 00:35:18.786985 14700 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:18.787036 14700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:18.787091 14700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:18.787693 14700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } }
I20260807 00:35:18.787823 14700 leader_election.cc:302] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90f09e3a6c0f456f9ed288fa60bc13bb; no voters:
I20260807 00:35:18.788084 14700 leader_election.cc:288] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:18.788113 14705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:18.788409 14705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 LEADER]: Becoming Leader. State: Replica: 90f09e3a6c0f456f9ed288fa60bc13bb, State: Running, Role: LEADER
I20260807 00:35:18.788535 14700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:18.788571 14705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } }
I20260807 00:35:18.789181 14705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90f09e3a6c0f456f9ed288fa60bc13bb. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } }
I20260807 00:35:18.789366 14705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:18.789656 14715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:18.789713 14707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } }
I20260807 00:35:18.789966 14707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:18.790243 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:18.779219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50326 (local address 127.7.252.62:44397)
0807 00:35:18.779424 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:18.779432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:18.779458 (+ 26us) server_negotiation.cc:407] Connection header received
0807 00:35:18.779888 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:18.779895 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:18.779941 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:18.780096 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:18.780750 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:18.781677 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:18.782515 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:18.783094 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:18.783212 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:18.786061 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:18.786066 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:18.786067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:18.786080 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:18.788082 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:18.788568 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:18.788572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:18.788572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:18.788721 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:18.788983 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:18.788984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:18.788985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:18.789332 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:18.789484 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:18.789877 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 00:35:18.790025 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
I20260807 00:35:18.790700 14715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:18.796092 14715 catalog_manager.cc:1347] Generated new cluster ID: 77eb4f7702b84253953b69228d6eaae2
I20260807 00:35:18.796191 14715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:18.805207 14715 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:18.806035 14715 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:18.815729 14715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Generated new TSK 0
I20260807 00:35:18.815964 14715 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab.
Entry for principal oryx/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab.
I20260807 00:35:18.850888 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44397
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:18.939246 14727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:18.939510 14727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:18.939556 14727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:18.940804 14727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:18.940855 14727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:18.940884 14727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:18.942494 14727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:18.942842 14727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:18.943109 14727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:18.948845 14732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:18.949036 14727 server_base.cc:1034] running on GCE node
W20260807 00:35:18.948932 14733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:18.948828 14735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:18.949412 14727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:18.949753 14727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:18.950938 14727 hybrid_clock.cc:648] HybridClock initialized: now 1786062918950924 us; error 31 us; skew 500 ppm
Aug 07 00:35:18 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:18.954051 14727 init.cc:377] Logged in from keytab as oryx/127.7.252.1@KRBTEST.COM (short username oryx)
I20260807 00:35:18.954742 14727 webserver.cc:460] Webserver started at http://127.7.252.1:35097/ using document root <none> and password file <none>
I20260807 00:35:18.955049 14727 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:18.955132 14727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:18.955309 14727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:18.956595 14727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "08f02f7233134c5396e938094a1219a5"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "4583ae89b34322ace58e004102d41de0"
server_key_iv: "6a35766e9a8fb3a71ba33a9f51dacdf5"
server_key_version: "encryptionkey@0"
I20260807 00:35:18.957058 14727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "08f02f7233134c5396e938094a1219a5"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "4583ae89b34322ace58e004102d41de0"
server_key_iv: "6a35766e9a8fb3a71ba33a9f51dacdf5"
server_key_version: "encryptionkey@0"
I20260807 00:35:18.958837 14727 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260807 00:35:18.959798 14742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:18.960052 14727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:18.960175 14727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "08f02f7233134c5396e938094a1219a5"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "4583ae89b34322ace58e004102d41de0"
server_key_iv: "6a35766e9a8fb3a71ba33a9f51dacdf5"
server_key_version: "encryptionkey@0"
I20260807 00:35:18.960249 14727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:18.969332 14727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:18.972357 14727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:18.972543 14727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:18.972827 14727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:18.973191 14727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:18.973251 14727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:18.973294 14727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:18.973322 14727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:18.979785 14727 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:34807
I20260807 00:35:18.979841 14861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:34807 every 8 connection(s)
I20260807 00:35:18.980175 14727 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:35:18 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:18.987206 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14727
I20260807 00:35:18.987367 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:18.987609 8176 external_mini_cluster.cc:1428] Setting key 6fa984a399690886cfa42a6b28fe37ca
I20260807 00:35:18.991237 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:18.980946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:43617 (local address 127.7.252.62:44397)
0807 00:35:18.980994 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:18.980996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:18.981241 (+ 245us) server_negotiation.cc:407] Connection header received
0807 00:35:18.981802 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:18.981804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:18.981818 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:18.981875 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:18.982976 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:18.983499 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:18.984532 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:18.984760 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:18.984849 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:18.987521 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:18.987523 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:18.987523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:18.987533 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:18.989294 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:18.989990 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:18.989990 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:18.989991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:18.990051 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:18.990394 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:18.990395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:18.990396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:18.990560 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:18.990639 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:18.991008 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 00:35:18.991113 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:35:18.991339 14864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:18.980922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:43617)
0807 00:35:18.981103 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:18.981141 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:18.981679 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:18.981948 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:18.981952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:18.982590 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:18.982871 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:18.982877 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:18.983607 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:18.983608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:18.984435 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:18.984437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:18.984866 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:18.984867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:18.985015 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:18.985605 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:18.985614 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:18.987395 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:18.989399 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:18.989409 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:18.989411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:18.989898 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:18.990123 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:18.990124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:18.990124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:18.990307 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:18.990640 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:18.990646 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:18.990863 (+ 217us) client_negotiation.cc:769] Sending connection context
0807 00:35:18.990963 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 00:35:18.991108 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260807 00:35:18.991966 14862 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44397
I20260807 00:35:18.992089 14862 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:18.992304 14862 heartbeater.cc:511] Master 127.7.252.62:44397 requested a full tablet report, sending...
I20260807 00:35:18.992918 14663 ts_manager.cc:194] Registered new tserver with Master: 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:18.993924 14663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:43617
WARNING: no policy specified for oryx/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab.
Entry for principal oryx/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab.
I20260807 00:35:19.019374 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44397
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:19.109040 14867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:19.109335 14867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:19.109381 14867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:19.110787 14867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:19.110859 14867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:19.110910 14867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:19.112589 14867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:19.112923 14867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:19.113205 14867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:19.118943 14875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.118980 14867 server_base.cc:1034] running on GCE node
W20260807 00:35:19.118963 14873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.118991 14872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.119439 14867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:19.119711 14867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:19.120913 14867 hybrid_clock.cc:648] HybridClock initialized: now 1786062919120877 us; error 54 us; skew 500 ppm
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:19.124045 14867 init.cc:377] Logged in from keytab as oryx/127.7.252.2@KRBTEST.COM (short username oryx)
I20260807 00:35:19.124606 14867 webserver.cc:460] Webserver started at http://127.7.252.2:38767/ using document root <none> and password file <none>
I20260807 00:35:19.124864 14867 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.124934 14867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.125085 14867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:19.126235 14867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "005b5c1435fb4e03b896893fefbe588b"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "b324167097a83102a7b92afe15661c55"
server_key_iv: "19f20623f7cece5b77a10db53ece9ac5"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.126643 14867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "005b5c1435fb4e03b896893fefbe588b"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "b324167097a83102a7b92afe15661c55"
server_key_iv: "19f20623f7cece5b77a10db53ece9ac5"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.128263 14867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:19.129101 14882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.129436 14867 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:19.129563 14867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "005b5c1435fb4e03b896893fefbe588b"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "b324167097a83102a7b92afe15661c55"
server_key_iv: "19f20623f7cece5b77a10db53ece9ac5"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.129647 14867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.140015 14867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:19.142380 14867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:19.142575 14867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:19.142910 14867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:19.143288 14867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:19.143356 14867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.143404 14867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:19.143431 14867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.150278 14867 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:43675
I20260807 00:35:19.150365 14998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:43675 every 8 connection(s)
I20260807 00:35:19.150831 14867 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:19.155949 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 14867
I20260807 00:35:19.156091 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:19.156364 8176 external_mini_cluster.cc:1428] Setting key 990e3c5abd821b288d9300d43f4c367f
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:19.162642 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.151779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:46337 (local address 127.7.252.62:44397)
0807 00:35:19.151863 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.151867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.152047 (+ 180us) server_negotiation.cc:407] Connection header received
0807 00:35:19.152682 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.152684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.152698 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.152754 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.153883 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.154459 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.155667 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.155898 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.155995 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.158525 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.158528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.158528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.158536 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.160495 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.161063 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.161065 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.161065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.161134 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.161452 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.161453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.161454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.161611 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.161681 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.162196 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.162365 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:35:19.162678 15001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.151661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:46337)
0807 00:35:19.151898 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.151957 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.152546 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.152831 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.152835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.153510 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.153726 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.153768 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.154571 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.154573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.155557 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.155559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.156014 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.156015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.156173 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.156844 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.156853 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.158418 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.160716 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.160724 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.160726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.160975 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.161255 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.161256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.161256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.161376 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.161682 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.161719 (+ 37us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.161963 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.162113 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.162335 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":99,"threads_started":1}
I20260807 00:35:19.163307 14999 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44397
I20260807 00:35:19.163429 14999 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:19.163652 14999 heartbeater.cc:511] Master 127.7.252.62:44397 requested a full tablet report, sending...
I20260807 00:35:19.164161 14663 ts_manager.cc:194] Registered new tserver with Master: 005b5c1435fb4e03b896893fefbe588b (127.7.252.2:43675)
I20260807 00:35:19.164683 14663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:46337
WARNING: no policy specified for oryx/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab.
Entry for principal oryx/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab.
I20260807 00:35:19.190889 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44397
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:19.280781 15004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:19.281018 15004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:19.281044 15004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:19.282291 15004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:19.282341 15004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:19.282369 15004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:19.284030 15004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:19.284323 15004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:19.284596 15004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:19.290216 15012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.290328 15009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.290351 15010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.290611 15004 server_base.cc:1034] running on GCE node
I20260807 00:35:19.290867 15004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:19.291141 15004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:19.292519 15004 hybrid_clock.cc:648] HybridClock initialized: now 1786062919292497 us; error 28 us; skew 500 ppm
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:19.295384 15004 init.cc:377] Logged in from keytab as oryx/127.7.252.3@KRBTEST.COM (short username oryx)
I20260807 00:35:19.295917 15004 webserver.cc:460] Webserver started at http://127.7.252.3:40547/ using document root <none> and password file <none>
I20260807 00:35:19.296139 15004 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.296182 15004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.296290 15004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:19.297363 15004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "2379e2a92ea44b86a3c37f6d59354364"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "7d0f30837bb407506e3da431fba01fb3"
server_key_iv: "b5e7edb18ee58c0d287af17a67c8968a"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.297667 15004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "2379e2a92ea44b86a3c37f6d59354364"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "7d0f30837bb407506e3da431fba01fb3"
server_key_iv: "b5e7edb18ee58c0d287af17a67c8968a"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.299113 15004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:19.300103 15020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.300590 15004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:19.300714 15004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "2379e2a92ea44b86a3c37f6d59354364"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "7d0f30837bb407506e3da431fba01fb3"
server_key_iv: "b5e7edb18ee58c0d287af17a67c8968a"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.300812 15004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.322067 15004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:19.324434 15004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:19.324606 15004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:19.324893 15004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:19.325260 15004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:19.325296 15004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.325320 15004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:19.325333 15004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.331651 15004 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:34105
I20260807 00:35:19.331694 15136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:34105 every 8 connection(s)
I20260807 00:35:19.332026 15004 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:19.337879 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 15004
I20260807 00:35:19.338022 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:19.338203 8176 external_mini_cluster.cc:1428] Setting key 57251aa9519e2d7a44178e1bd18a3599
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:19.343169 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.332836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:56459 (local address 127.7.252.62:44397)
0807 00:35:19.332919 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.332922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.333179 (+ 257us) server_negotiation.cc:407] Connection header received
0807 00:35:19.333675 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.333676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.333695 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.333753 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.334927 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.335527 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.336571 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.336776 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.336842 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.339796 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.339798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.339798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.339807 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.341507 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.342035 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.342036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.342037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.342103 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.342391 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.342392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.342393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.342530 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.342612 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.342976 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.343069 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:35:19.343390 15139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.332808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:56459)
0807 00:35:19.332996 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.333037 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.333530 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.333848 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.333852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.334567 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.334834 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.334840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.335632 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.335633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.336484 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.336487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.336864 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.336865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.336982 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.337516 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.337526 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.339672 (+ 2146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.341645 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.341656 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.341658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.341942 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.342185 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.342186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.342186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.342312 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.342600 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.342608 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.342827 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.342942 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.343128 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":106,"threads_started":1}
I20260807 00:35:19.344165 15137 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44397
I20260807 00:35:19.344280 15137 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:19.344506 15137 heartbeater.cc:511] Master 127.7.252.62:44397 requested a full tablet report, sending...
I20260807 00:35:19.345104 14663 ts_manager.cc:194] Registered new tserver with Master: 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105)
I20260807 00:35:19.345531 14663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:56459
I20260807 00:35:19.350498 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.252.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.61.keytab.
Entry for principal oryx/127.7.252.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.61.keytab.
I20260807 00:35:19.384049 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:35847
--webserver_interface=127.7.252.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.61.keytab
--principal=oryx/127.7.252.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44397,127.7.252.61:35847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:19.470060 15142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:19.470329 15142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:19.470371 15142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:19.471755 15142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:19.471836 15142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:19.471864 15142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:19.471896 15142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:19.471922 15142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:19.473521 15142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44397,127.7.252.61:35847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.61.keytab
--principal=oryx/127.7.252.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:35847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.252.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
W20260807 00:35:19.473676 15142 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.7.252.62:44397,127.7.252.61:35847'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 00:35:19.473853 15142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:19.474104 15142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:19.479558 15150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.479614 15148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.479558 15147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.480038 15142 server_base.cc:1034] running on GCE node
I20260807 00:35:19.480400 15142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:19.480739 15142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:19.481925 15142 hybrid_clock.cc:648] HybridClock initialized: now 1786062919481906 us; error 27 us; skew 500 ppm
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:19.485221 15142 init.cc:377] Logged in from keytab as oryx/127.7.252.61@KRBTEST.COM (short username oryx)
I20260807 00:35:19.485903 15142 webserver.cc:460] Webserver started at http://127.7.252.61:39299/ using document root <none> and password file <none>
I20260807 00:35:19.486184 15142 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.486269 15142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.486475 15142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:19.487804 15142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/instance:
uuid: "6ff2733cb6784698920605222a3bcdf7"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "f882dca5e03b0ec2b159b7cf5814f0e2"
server_key_iv: "f2b80b44f48334803b968d5e047f8028"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.488330 15142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal/instance:
uuid: "6ff2733cb6784698920605222a3bcdf7"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "f882dca5e03b0ec2b159b7cf5814f0e2"
server_key_iv: "f2b80b44f48334803b968d5e047f8028"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.490144 15142 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 00:35:19.491221 15157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.491588 15142 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:19.491710 15142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
uuid: "6ff2733cb6784698920605222a3bcdf7"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "f882dca5e03b0ec2b159b7cf5814f0e2"
server_key_iv: "f2b80b44f48334803b968d5e047f8028"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.491796 15142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.506227 15142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:19.508896 15142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:19.509080 15142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:19.513120 15142 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.61:35847
I20260807 00:35:19.513193 15214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.61:35847 every 8 connection(s)
I20260807 00:35:19.513576 15142 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
I20260807 00:35:19.514815 15215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:19.516446 15215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:35:19.520613 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 15142
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.61@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
I20260807 00:35:19.527236 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.517303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50342 (local address 127.7.252.62:44397)
0807 00:35:19.517392 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.517394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.517554 (+ 160us) server_negotiation.cc:407] Connection header received
0807 00:35:19.518150 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.518151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.518166 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.518261 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.518993 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.519547 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.520610 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.520868 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.520955 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.523670 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.523671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.523672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.523689 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.525460 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.525950 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.525952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.525952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.526021 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.526339 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.526341 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.526341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.526502 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.526571 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.527011 (+ 440us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.527105 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 00:35:19.527818 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.517156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50342)
0807 00:35:19.517407 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.517456 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.517991 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.518335 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.518339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.518610 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.518890 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.518894 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.519644 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.519646 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.520496 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.520498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.520965 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.520966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.521121 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.521886 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.521898 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.523563 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.525568 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.525575 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.525578 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.525862 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.526093 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.526094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.526094 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.526256 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.526595 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.526604 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.526823 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.527353 (+ 530us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.527555 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":126,"threads_started":1}
I20260807 00:35:19.528971 15215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:35:19.531123 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.521228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43574 (local address 127.7.252.61:35847)
0807 00:35:19.521397 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.521401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.521429 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:35:19.521495 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.521497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.521514 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.521581 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.522433 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.523160 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.524064 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.524609 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.524699 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.527453 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.527461 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.527462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.527471 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.529539 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.529945 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.529949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.529949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.530019 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.530258 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.530259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.530260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.530464 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.530633 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.530936 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.531018 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.61@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
I20260807 00:35:19.538420 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.529320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43576)
0807 00:35:19.529372 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.529383 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.529426 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.530585 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.530586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.530773 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.530834 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.530836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.531751 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.531752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.532468 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.532470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.532861 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.532862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.532924 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.533342 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.533346 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.534999 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.537426 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.537427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.537428 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.537596 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.537842 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.537843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.537843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.537894 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.538168 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.538169 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.538207 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.538264 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.538348 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 00:35:19.538550 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.529342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43576 (local address 127.7.252.61:35847)
0807 00:35:19.530421 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.530422 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.530430 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:19.530448 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.530448 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.530475 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.530539 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.530928 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.531669 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.532546 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.532802 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.532864 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.535101 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.535103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.535103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.535109 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.537336 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.537691 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.537692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.537692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.537768 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.537976 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.537977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.537978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.538103 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.538180 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.538282 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.538398 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":1058,"thread_start_us":124,"threads_started":1}
I20260807 00:35:19.539959 15215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Bootstrap starting.
I20260807 00:35:19.540671 15215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:19.540966 15215 log.cc:824] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:19.541874 15215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: No bootstrap required, opened a new log
I20260807 00:35:19.543411 15215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } }
I20260807 00:35:19.543562 15215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:19.543612 15215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff2733cb6784698920605222a3bcdf7, State: Initialized, Role: FOLLOWER
I20260807 00:35:19.543767 15215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } }
I20260807 00:35:19.544090 15215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:19.544113 15223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } } }
I20260807 00:35:19.544224 15223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:35:19.545913 15234 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:35:19.545969 15234 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:35:19.547505 15142 master_runner.cc:428] Detected that this master 6ff2733cb6784698920605222a3bcdf7 is joining an existing cluster
I20260807 00:35:19.547577 15142 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.252.61:35847
I20260807 00:35:19.555049 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.548643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50348 (local address 127.7.252.62:44397)
0807 00:35:19.548742 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.548744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.548848 (+ 104us) server_negotiation.cc:407] Connection header received
0807 00:35:19.548942 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.548944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.548956 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.549035 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.549419 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.549934 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.550738 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.550943 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.551030 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.552265 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.552267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.552267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.552275 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.553708 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.554166 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.554167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.554167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.554233 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.554460 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.554461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.554461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.554580 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.554660 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.554874 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.554952 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 00:35:19.555063 15240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.548590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50348)
0807 00:35:19.548764 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.548776 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.548843 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.549053 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.549055 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.549271 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.549336 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.549338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.550018 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.550019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.550614 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.550615 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.551053 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.551054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.551117 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.551649 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.551654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.552149 (+ 495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.553819 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.553820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.553820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.554061 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.554318 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.554319 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.554320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.554381 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.554649 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.554650 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.554729 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.554833 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.554948 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260807 00:35:19.556365 15241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.548634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43588)
0807 00:35:19.548764 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.548776 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.548843 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.549006 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.549007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.549271 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.549352 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.549354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.550287 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.550287 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.551147 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.551150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.551569 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.551569 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.551637 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.552023 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.552028 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.552411 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.554952 (+ 2541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.554953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.554953 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.555154 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.555416 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.555417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.555417 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.555485 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.555978 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.555979 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.556011 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.556120 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.556239 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260807 00:35:19.556448 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.548590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.7.252.61:35847)
0807 00:35:19.548704 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.548707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.548865 (+ 158us) server_negotiation.cc:407] Connection header received
0807 00:35:19.548890 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.548891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.548902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.548965 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.549440 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.550197 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.551239 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.551471 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.551559 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.552770 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.552771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.552771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.552779 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.554867 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.555269 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.555271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.555271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.555336 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.555579 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.555580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.555580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.555695 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.555786 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.556149 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.556308 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":89}
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.62@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
I20260807 00:35:19.566502 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.558119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.7.252.61:35847)
0807 00:35:19.558177 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.558179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.558353 (+ 174us) server_negotiation.cc:407] Connection header received
0807 00:35:19.558435 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.558436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.558444 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.558491 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.559069 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.559531 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.560662 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.560844 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.560899 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.563578 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.563580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.563581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.563588 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.565093 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.565549 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.565550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.565550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.565610 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.565909 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.565910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.565910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.566058 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.566128 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.566365 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.566436 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 00:35:19.566571 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.558061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43600)
0807 00:35:19.558230 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.558283 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.558358 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.558518 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.558523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.558920 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.558988 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.558990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.559611 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.559612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.560577 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.560579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.560919 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.560920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.561001 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.561437 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.561442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.563496 (+ 2054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.565222 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.565231 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.565233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.565455 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.565680 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.565681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.565681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.565743 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.566125 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.566135 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.566215 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.566320 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.566462 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":104,"threads_started":1}
I20260807 00:35:19.567312 14663 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.252.61:35847: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6ff2733cb6784698920605222a3bcdf7"
member_type: NON_VOTER
last_known_addr {
host: "127.7.252.61"
port: 35847
}
attrs {
promote: true
}
}
dest_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb"
cas_config_opid_index: -1
I20260807 00:35:19.567739 14663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } }
I20260807 00:35:19.568274 15244 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 6ff2733cb6784698920605222a3bcdf7 (127.7.252.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } }
I20260807 00:35:19.568620 15186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:19.569309 15244 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.252.61:35847
I20260807 00:35:19.569590 15186 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Refusing update from remote peer 90f09e3a6c0f456f9ed288fa60bc13bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 00:35:19.569649 15142 master.cc:537] Master@127.7.252.61:35847 shutting down...
I20260807 00:35:19.569947 15244 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 00:35:19.570735 14650 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260807 00:35:19.571076 15243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } }
W20260807 00:35:19.571125 14650 consensus_peers.cc:487] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb -> Peer 6ff2733cb6784698920605222a3bcdf7 (127.7.252.61:35847): Couldn't send request to peer 6ff2733cb6784698920605222a3bcdf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 00:35:19.571162 15243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:19.572741 15142 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:19.572832 15142 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:19.572880 15142 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: stopping tablet replica
I20260807 00:35:19.586270 15142 master.cc:552] Master@127.7.252.61:35847 shutdown complete.
I20260807 00:35:19.586382 15142 master_runner.cc:305] Clearing existing system tablet
I20260807 00:35:19.586532 15142 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.586602 15142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.587399 15142 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.587970 15248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.588132 15142 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.588194 15142 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 00:35:19.588285 15142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
uuid: "6ff2733cb6784698920605222a3bcdf7"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "f882dca5e03b0ec2b159b7cf5814f0e2"
server_key_iv: "f2b80b44f48334803b968d5e047f8028"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.589035 15142 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:19.591176 15142 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 00:35:19.591270 15142 log.cc:1196] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 00:35:19.591509 15142 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Deleting consensus metadata
I20260807 00:35:19.591652 15142 master_runner.cc:315] Copying system tablet from 127.7.252.62:44397
I20260807 00:35:19.592368 15142 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.252.62:44397
I20260807 00:35:19.599180 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.592862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50352 (local address 127.7.252.62:44397)
0807 00:35:19.592911 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.592913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.593040 (+ 127us) server_negotiation.cc:407] Connection header received
0807 00:35:19.593126 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.593127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.593138 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.593185 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.593562 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.594075 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.594888 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.595107 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.595196 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.596217 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.596218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.596219 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.596228 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.597805 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.598176 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.598177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.598178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.598244 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.598459 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.598460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.598461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.598578 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.598658 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.598985 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.599077 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:19.599197 15254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.592769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50352)
0807 00:35:19.592956 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.592971 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.593057 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.593187 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.593188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.593406 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.593468 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.593470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.594160 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.594161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.594801 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.594803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.595198 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.595199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.595264 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.595781 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.595786 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.596113 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.597911 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.597912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.597913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.598100 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.598320 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.598321 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.598321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.598382 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.598704 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.598705 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.598770 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.598939 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.599079 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260807 00:35:19.599742 14683 tablet_copy_service.cc:140] P 90f09e3a6c0f456f9ed288fa60bc13bb: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6ff2733cb6784698920605222a3bcdf7 ({username='oryx', principal='oryx/127.7.252.61@KRBTEST.COM'} at 127.0.0.1:50352)
I20260807 00:35:19.599874 14683 tablet_copy_service.cc:161] P 90f09e3a6c0f456f9ed288fa60bc13bb: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6ff2733cb6784698920605222a3bcdf7 at {username='oryx', principal='oryx/127.7.252.61@KRBTEST.COM'} at 127.0.0.1:50352: session id = 6ff2733cb6784698920605222a3bcdf7-00000000000000000000000000000000
I20260807 00:35:19.600662 14683 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 00:35:19.601330 15142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 00:35:19.602452 15142 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: tablet copy: Starting download of 0 data blocks...
I20260807 00:35:19.602613 15142 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: tablet copy: Starting download of 1 WAL segments...
I20260807 00:35:19.603716 15142 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 00:35:19.604702 14683 tablet_copy_service.cc:342] P 90f09e3a6c0f456f9ed288fa60bc13bb: Request end of tablet copy session 6ff2733cb6784698920605222a3bcdf7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.252.61@KRBTEST.COM'} at 127.0.0.1:50352
I20260807 00:35:19.604786 14683 tablet_copy_service.cc:433] P 90f09e3a6c0f456f9ed288fa60bc13bb: ending tablet copy session 6ff2733cb6784698920605222a3bcdf7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6ff2733cb6784698920605222a3bcdf7
I20260807 00:35:19.607863 15142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:19.609409 15255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.609524 15142 server_base.cc:1034] running on GCE node
W20260807 00:35:19.609608 15258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.609826 15256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.609984 15142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:19.610163 15142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:19.611366 15142 hybrid_clock.cc:648] HybridClock initialized: now 1786062919611357 us; error 29 us; skew 500 ppm
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:19.612879 15142 init.cc:377] Logged in from keytab as oryx/127.7.252.61@KRBTEST.COM (short username oryx)
I20260807 00:35:19.613226 15142 webserver.cc:460] Webserver started at http://127.7.252.61:40859/ using document root <none> and password file <none>
I20260807 00:35:19.613457 15142 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.613504 15142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.614238 15142 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260807 00:35:19.615001 15265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.615211 15142 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:19.615335 15142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
uuid: "6ff2733cb6784698920605222a3bcdf7"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "f882dca5e03b0ec2b159b7cf5814f0e2"
server_key_iv: "f2b80b44f48334803b968d5e047f8028"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.615408 15142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.654109 15142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:19.656191 15142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:19.659567 15142 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.61:35847
I20260807 00:35:19.659593 15318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.61:35847 every 8 connection(s)
I20260807 00:35:19.659912 15142 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
I20260807 00:35:19.660717 15319 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:35:19.661414 15319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Bootstrap starting.
I20260807 00:35:19.664175 15319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:35:19.664446 15319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: Bootstrap complete.
I20260807 00:35:19.664665 15319 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } }
I20260807 00:35:19.664763 15319 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ff2733cb6784698920605222a3bcdf7, State: Initialized, Role: LEARNER
I20260807 00:35:19.664808 15319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } }
I20260807 00:35:19.665014 15319 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:19.665042 15322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } }
I20260807 00:35:19.665160 15322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: LEARNER
I20260807 00:35:19.666528 15333 catalog_manager.cc:1259] Loaded cluster ID: 77eb4f7702b84253953b69228d6eaae2
I20260807 00:35:19.666764 15333 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: loading cluster ID for follower catalog manager: success
I20260807 00:35:19.667623 15333 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: acquiring CA information for follower catalog manager: success
I20260807 00:35:19.667904 15333 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 00:35:19.692432 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.685444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43626 (local address 127.7.252.61:35847)
0807 00:35:19.685610 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.685612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.685619 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:35:19.685644 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.685645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.685654 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.685731 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.686438 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.687174 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.687954 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.688157 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.688253 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.689598 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.689599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.689600 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.689608 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.691164 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.691557 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.691559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.691559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.691621 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.691841 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.691842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.691843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.691971 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.692078 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.692211 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.692313 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for oryx/127.7.252.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.60.keytab.
Entry for principal oryx/127.7.252.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.60.keytab.
I20260807 00:35:19.728485 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:44575
--webserver_interface=127.7.252.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.60.keytab
--principal=oryx/127.7.252.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:19.817489 15337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:19.817718 15337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:19.817742 15337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:19.819043 15337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:19.819092 15337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:19.819106 15337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:19.819119 15337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:19.819132 15337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:19.820742 15337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.60.keytab
--principal=oryx/127.7.252.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:44575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.252.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:19.821018 15337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:19.821288 15337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:19.826699 15347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.826861 15337 server_base.cc:1034] running on GCE node
W20260807 00:35:19.826924 15343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:19.826854 15342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:19.827255 15337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:19.827652 15337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:19.828817 15337 hybrid_clock.cc:648] HybridClock initialized: now 1786062919828792 us; error 42 us; skew 500 ppm
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:19.831574 15337 init.cc:377] Logged in from keytab as oryx/127.7.252.60@KRBTEST.COM (short username oryx)
I20260807 00:35:19.832113 15337 webserver.cc:460] Webserver started at http://127.7.252.60:34229/ using document root <none> and password file <none>
I20260807 00:35:19.832391 15337 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.832445 15337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.832650 15337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:19.833880 15337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/instance:
uuid: "b33751849255462fad0d738561cce4f1"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "8bb4dec0603ae235b324ec873b719c5f"
server_key_iv: "117daa330f811d07e985e1a9caa7819f"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.834285 15337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal/instance:
uuid: "b33751849255462fad0d738561cce4f1"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "8bb4dec0603ae235b324ec873b719c5f"
server_key_iv: "117daa330f811d07e985e1a9caa7819f"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.835820 15337 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:19.836802 15354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.837085 15337 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:19.837189 15337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
uuid: "b33751849255462fad0d738561cce4f1"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "8bb4dec0603ae235b324ec873b719c5f"
server_key_iv: "117daa330f811d07e985e1a9caa7819f"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.837345 15337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.862032 15337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:19.865073 15337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:19.865227 15337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:19.870126 15337 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.60:44575
I20260807 00:35:19.870222 15407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.60:44575 every 8 connection(s)
I20260807 00:35:19.870550 15337 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
I20260807 00:35:19.871667 15408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:19.873386 15408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:35:19.875702 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 15337
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.60@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.252.60@KRBTEST.COM
I20260807 00:35:19.885113 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.874218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50362 (local address 127.7.252.62:44397)
0807 00:35:19.874296 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.874298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.874429 (+ 131us) server_negotiation.cc:407] Connection header received
0807 00:35:19.874921 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.874922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.874933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.875004 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.875713 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.876630 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.878270 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.878565 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.878679 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.881512 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.881513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.881514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.881522 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.883248 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.883691 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.883692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.883692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.883774 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.884088 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.884089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.884089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.884391 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.884478 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.884891 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.884993 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:35:19.885210 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.874121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50362)
0807 00:35:19.874293 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.874336 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.874819 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.875059 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.875062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.875340 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.875587 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.875593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.876752 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.876753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.878131 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.878133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.878698 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.878698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.878853 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.879495 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.879506 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.881406 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.883320 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.883329 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.883332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.883605 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.883855 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.883855 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.883856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.884009 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.884489 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.884495 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.884675 (+ 180us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.884804 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.884980 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260807 00:35:19.885843 15408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:35:19.887323 15411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.876350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33044 (local address 127.7.252.60:44575)
0807 00:35:19.876563 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.876569 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.876596 (+ 27us) server_negotiation.cc:407] Connection header received
0807 00:35:19.876618 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.876620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.876642 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.876723 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.877496 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.878643 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.880166 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.880620 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.880991 (+ 371us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.883754 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.883762 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.883762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.883769 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.885909 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.886437 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.886441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.886442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.886512 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.886745 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.886745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.886746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.886903 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.887090 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.887134 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.887209 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":116,"threads_started":1}
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.60@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
I20260807 00:35:19.893644 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.886211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43636 (local address 127.7.252.61:35847)
0807 00:35:19.886252 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.886254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.886263 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:19.886320 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.886321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.886333 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.886397 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.886708 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.887231 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.888327 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.888554 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.888628 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.890776 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.890778 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.890778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.890787 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.892308 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.892710 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.892711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.892711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.892778 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.893075 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.893076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.893077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.893209 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.893288 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.893460 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.893552 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:35:19.893644 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.886141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43636)
0807 00:35:19.886201 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.886213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.886259 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.886385 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.886386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.886552 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.886600 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.886601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.887323 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.887324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.888239 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.888242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.888636 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.888637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.888707 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.889177 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.889182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.890593 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.892459 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.892460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.892461 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.892633 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.892848 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.892849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.892849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.892993 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.893291 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.893292 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.893338 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.893421 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.893533 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 00:35:19.894240 15408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062919, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.60@KRBTEST.COM for oryx/127.7.252.60@KRBTEST.COM
I20260807 00:35:19.901779 15411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.894616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33058 (local address 127.7.252.60:44575)
0807 00:35:19.894679 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.894681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.894726 (+ 45us) server_negotiation.cc:407] Connection header received
0807 00:35:19.894793 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.894793 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.894802 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.894844 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.895072 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.895602 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.896450 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.896664 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.896739 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.898824 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.898825 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.898826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.898832 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.900527 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.900937 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.900938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.900939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.900997 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.901192 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.901192 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.901193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.901376 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.901434 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.901581 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.901695 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":19}
I20260807 00:35:19.901795 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.894560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33058)
0807 00:35:19.894641 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.894689 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.894747 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.894852 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.894853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.894971 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.895007 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.895008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.895718 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.895720 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.896282 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.896285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.896798 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.896799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.896851 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.897351 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.897355 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.898718 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.900625 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.900626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.900626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.900837 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.901071 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.901071 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.901071 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.901131 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.901443 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.901444 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.901488 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.901549 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.901642 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 00:35:19.903576 15408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Bootstrap starting.
I20260807 00:35:19.904592 15408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:19.904856 15408 log.cc:824] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:19.905869 15408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: No bootstrap required, opened a new log
I20260807 00:35:19.907624 15408 raft_consensus.cc:348] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } }
I20260807 00:35:19.907771 15408 raft_consensus.cc:374] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:19.907795 15408 raft_consensus.cc:729] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b33751849255462fad0d738561cce4f1, State: Initialized, Role: FOLLOWER
I20260807 00:35:19.907900 15408 consensus_queue.cc:260] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } }
I20260807 00:35:19.908180 15408 sys_catalog.cc:564] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:19.908177 15413 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } } }
I20260807 00:35:19.908377 15413 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:35:19.910396 15424 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:35:19.910462 15424 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:35:19.913143 15337 master_runner.cc:428] Detected that this master b33751849255462fad0d738561cce4f1 is joining an existing cluster
I20260807 00:35:19.913193 15337 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.252.60:44575
I20260807 00:35:19.921730 15430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.914356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50364)
0807 00:35:19.914574 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.914584 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.914659 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.914881 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.914882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.915186 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.915289 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.915291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.916142 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.916144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.917154 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.917156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.917591 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.917592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.917655 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.918181 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.918186 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.918519 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.920458 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.920459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.920460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.920698 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.920960 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.920961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.920962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.921031 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.921345 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.921347 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.921404 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.921485 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.921597 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":31,"thread_start_us":152,"threads_started":1}
I20260807 00:35:19.921733 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.914583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50364 (local address 127.7.252.62:44397)
0807 00:35:19.914694 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.914697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.914707 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:19.914757 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.914759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.914772 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.914827 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.915395 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.916045 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.917283 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.917500 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.917583 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.918622 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.918624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.918624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.918633 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.920368 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.920812 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.920814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.920815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.920886 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.921111 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.921112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.921113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.921262 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.921335 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.921530 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.921617 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 00:35:19 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062918, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.62@KRBTEST.COM for oryx/127.7.252.60@KRBTEST.COM
I20260807 00:35:19.937845 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.914893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.7.252.61:35847)
0807 00:35:19.914941 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.914944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.918882 (+ 3938us) server_negotiation.cc:407] Connection header received
0807 00:35:19.918924 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.918926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.918941 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.919002 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.919968 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.920673 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.921779 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.922067 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.922112 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.923262 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.923263 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.923263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.923272 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.924890 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.936032 (+ 11142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.936034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.936034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.936113 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.936643 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.936644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.936645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.937060 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.937131 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.937615 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.937721 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:19.938267 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.914902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43640)
0807 00:35:19.918789 (+ 3887us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.918801 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.918869 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.919019 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.919020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.919786 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.919860 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.919862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.920759 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.920760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.921660 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.921663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.922203 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.922204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.922279 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.922789 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.922794 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.923165 (+ 371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.924990 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.924991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.924992 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.935913 (+ 10921us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.936438 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.936439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.936440 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.936536 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.937173 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.937173 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.937228 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.937957 (+ 729us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.938100 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3859,"thread_start_us":77,"threads_started":1}
I20260807 00:35:19.938772 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.924938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33086)
0807 00:35:19.925181 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.925195 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.925257 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.925411 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.925412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.925576 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.925618 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.925620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.926310 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.926311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.926923 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.926925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.927306 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.927308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.927381 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.927828 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.927833 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.929088 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.937474 (+ 8386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.937476 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.937477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.937735 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.938037 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.938038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.938039 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.938107 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.938388 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.938390 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.938444 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.938516 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.938640 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260807 00:35:19.938977 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14727
I20260807 00:35:19.939229 15433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.924995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33086 (local address 127.7.252.60:44575)
0807 00:35:19.925198 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.925200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.925239 (+ 39us) server_negotiation.cc:407] Connection header received
0807 00:35:19.925327 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.925328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.925339 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.925404 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.925723 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.926208 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.927017 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.927233 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.927307 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.929194 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.929195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.929196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.929203 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.937362 (+ 8159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.937823 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.937823 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.937824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.937895 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.938180 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.938181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.938182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.938326 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.938392 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.938977 (+ 585us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.939076 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":129,"threads_started":1}
I20260807 00:35:19.941056 15411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.914644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.7.252.60:44575)
0807 00:35:19.914718 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.914720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.914842 (+ 122us) server_negotiation.cc:407] Connection header received
0807 00:35:19.914923 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.914923 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.914931 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.914957 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.915379 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.916144 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.917254 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.917556 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.917633 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.936443 (+ 18810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.936444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.936444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.936452 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.938777 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.940128 (+ 1351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.940129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.940129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.940178 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.940356 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.940356 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.940357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.940473 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.940525 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.940905 (+ 380us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.940976 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:35:19.941402 15431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.914363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33070)
0807 00:35:19.914790 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.914800 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.914863 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.915023 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.915023 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.915222 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.915288 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.915291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.916223 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.916224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.917154 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.917157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.917684 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.917685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.917746 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.935191 (+ 17445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.935198 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.936344 (+ 1146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.939823 (+ 3479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.939824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.939825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.940048 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.940239 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.940239 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.940240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.940287 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.940544 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.940545 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.940579 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.940638 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.940739 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":35,"thread_start_us":99,"threads_started":1}
I20260807 00:35:19.947503 14663 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.252.60:44575: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b33751849255462fad0d738561cce4f1"
member_type: NON_VOTER
last_known_addr {
host: "127.7.252.60"
port: 44575
}
attrs {
promote: true
}
}
dest_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb"
cas_config_opid_index: 5
I20260807 00:35:19.947856 14663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } }
I20260807 00:35:19.948464 15243 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b33751849255462fad0d738561cce4f1 (127.7.252.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.948757 15382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:19.949543 15243 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.252.60:44575
I20260807 00:35:19.949633 15243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.949708 15243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:19.950014 15382 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Refusing update from remote peer 90f09e3a6c0f456f9ed288fa60bc13bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 00:35:19.950029 15337 master.cc:537] Master@127.7.252.60:44575 shutting down...
I20260807 00:35:19.951197 15434 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:19.952080 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:34807
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:44397
--webserver_port=35097
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:19.952246 14647 consensus_peers.cc:487] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb -> Peer b33751849255462fad0d738561cce4f1 (127.7.252.60:44575): Couldn't send request to peer b33751849255462fad0d738561cce4f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 00:35:19.954631 15337 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:19.954763 15337 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:19.954840 15337 tablet_replica.cc:330] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: stopping tablet replica
I20260807 00:35:19.955497 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.951068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43654 (local address 127.7.252.61:35847)
0807 00:35:19.951436 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.951439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.951448 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:19.951476 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.951477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.951502 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.951567 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:19.952320 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.953078 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.954301 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.954965 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.955043 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.955131 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.955371 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.955425 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341}
I20260807 00:35:19.955498 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.950954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43654)
0807 00:35:19.951061 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.951074 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.951120 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.951637 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.951638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.951641 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:19.951697 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.951699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.953180 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.953182 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.954198 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.954201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.955170 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.955171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.955248 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.955279 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.955356 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.955408 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 00:35:19.956110 15292 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 LEARNER]: Refusing update from remote peer 90f09e3a6c0f456f9ed288fa60bc13bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 00:35:19.956498 15434 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 00:35:19.957443 15292 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b33751849255462fad0d738561cce4f1 (127.7.252.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.959244 15322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90f09e3a6c0f456f9ed288fa60bc13bb. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.959383 15322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: LEARNER
I20260807 00:35:19.959434 15322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: NON_VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: true } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.959504 15322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: LEARNER
I20260807 00:35:19.960376 15434 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: attempting to promote NON_VOTER 6ff2733cb6784698920605222a3bcdf7 to VOTER
I20260807 00:35:19.960619 15434 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } }
I20260807 00:35:19.961275 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.961099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33096)
0807 00:35:19.961166 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.961231 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:44575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 00:35:19.961313 15292 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 LEARNER]: Refusing update from remote peer 90f09e3a6c0f456f9ed288fa60bc13bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 00:35:19.961611 15243 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 00:35:19.961674 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.961540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33106)
0807 00:35:19.961578 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.961604 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:44575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260807 00:35:19.961759 14647 consensus_peers.cc:487] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb -> Peer b33751849255462fad0d738561cce4f1 (127.7.252.60:44575): Couldn't send request to peer b33751849255462fad0d738561cce4f1. Status: Network error: Client connection negotiation failed: client connection to 127.7.252.60:44575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 00:35:19.962399 15243 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6ff2733cb6784698920605222a3bcdf7 (127.7.252.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.963472 15243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.963557 15243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:19.963603 15243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.963651 15243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:19.963925 15292 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6ff2733cb6784698920605222a3bcdf7 (127.7.252.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.964927 15437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:19.965119 15437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:35:19.971491 15337 master.cc:552] Master@127.7.252.60:44575 shutdown complete.
I20260807 00:35:19.971568 15337 master_runner.cc:305] Clearing existing system tablet
I20260807 00:35:19.971725 15337 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:19.971784 15337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:19.972590 15337 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:35:19.973165 15439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:19.973289 15337 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:19.973348 15337 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 00:35:19.973372 15337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
uuid: "b33751849255462fad0d738561cce4f1"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "8bb4dec0603ae235b324ec873b719c5f"
server_key_iv: "117daa330f811d07e985e1a9caa7819f"
server_key_version: "encryptionkey@0"
I20260807 00:35:19.974205 15337 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:19.976445 15337 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 00:35:19.976547 15337 log.cc:1196] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 00:35:19.976819 15337 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Deleting consensus metadata
I20260807 00:35:19.976969 15337 master_runner.cc:315] Copying system tablet from 127.7.252.62:44397
I20260807 00:35:19.977692 15337 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: tablet copy: Beginning tablet copy session from remote peer at address 127.7.252.62:44397
I20260807 00:35:19.990440 15445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.978959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50376)
0807 00:35:19.982793 (+ 3834us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:19.982811 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:19.982916 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:19.983110 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:19.983111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:19.983334 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:19.983402 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.983405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.984493 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.984494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.985330 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:19.985332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.985931 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.985932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:19.985989 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.986607 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:19.986612 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:19.987067 (+ 455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:19.989170 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.989172 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.989172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.989442 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.989680 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:19.989682 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:19.989682 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:19.989756 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:19.990062 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:19.990063 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:19.990117 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 00:35:19.990191 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 00:35:19.990309 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3801,"thread_start_us":108,"threads_started":1}
I20260807 00:35:19.990505 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:19.979038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50376 (local address 127.7.252.62:44397)
0807 00:35:19.979090 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:19.979092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:19.982924 (+ 3832us) server_negotiation.cc:407] Connection header received
0807 00:35:19.983004 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:19.983005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:19.983022 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:19.983088 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:19.983503 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.984387 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.985450 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:19.985839 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:19.985923 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:19.987177 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:19.987179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:19.987179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:19.987189 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:19.989068 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.989525 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.989527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.989527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.989601 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:19.989830 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:19.989831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:19.989832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:19.989985 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:19.990064 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:19.990239 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 00:35:19.990331 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 00:35:19.991261 14683 tablet_copy_service.cc:140] P 90f09e3a6c0f456f9ed288fa60bc13bb: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b33751849255462fad0d738561cce4f1 ({username='oryx', principal='oryx/127.7.252.60@KRBTEST.COM'} at 127.0.0.1:50376)
I20260807 00:35:19.991338 14683 tablet_copy_service.cc:161] P 90f09e3a6c0f456f9ed288fa60bc13bb: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b33751849255462fad0d738561cce4f1 at {username='oryx', principal='oryx/127.7.252.60@KRBTEST.COM'} at 127.0.0.1:50376: session id = b33751849255462fad0d738561cce4f1-00000000000000000000000000000000
I20260807 00:35:19.992007 14683 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 00:35:19.992579 15337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 00:35:19.993973 15337 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: tablet copy: Starting download of 0 data blocks...
I20260807 00:35:19.994128 15337 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: tablet copy: Starting download of 1 WAL segments...
I20260807 00:35:19.995198 15337 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 00:35:19.996616 14683 tablet_copy_service.cc:342] P 90f09e3a6c0f456f9ed288fa60bc13bb: Request end of tablet copy session b33751849255462fad0d738561cce4f1-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.252.60@KRBTEST.COM'} at 127.0.0.1:50376
I20260807 00:35:19.996691 14683 tablet_copy_service.cc:433] P 90f09e3a6c0f456f9ed288fa60bc13bb: ending tablet copy session b33751849255462fad0d738561cce4f1-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b33751849255462fad0d738561cce4f1
I20260807 00:35:19.999528 15337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:20.001204 15446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:20.004681 15449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:20.004690 15337 server_base.cc:1034] running on GCE node
W20260807 00:35:20.007948 15447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:20.008148 15337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:20.008327 15337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:20.009581 15337 hybrid_clock.cc:648] HybridClock initialized: now 1786062920009557 us; error 44 us; skew 500 ppm
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:20.011430 15337 init.cc:377] Logged in from keytab as oryx/127.7.252.60@KRBTEST.COM (short username oryx)
I20260807 00:35:20.011760 15337 webserver.cc:460] Webserver started at http://127.7.252.60:39137/ using document root <none> and password file <none>
I20260807 00:35:20.011894 15337 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:20.011937 15337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:20.012760 15337 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:20.013460 15456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.013625 15337 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.013685 15337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
uuid: "b33751849255462fad0d738561cce4f1"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "8bb4dec0603ae235b324ec873b719c5f"
server_key_iv: "117daa330f811d07e985e1a9caa7819f"
server_key_version: "encryptionkey@0"
I20260807 00:35:20.013763 15337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:20.041394 15337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:20.043669 15337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:20.047137 15337 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.60:44575
I20260807 00:35:20.047184 15511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.60:44575 every 8 connection(s)
I20260807 00:35:20.047547 15337 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
I20260807 00:35:20.048625 15513 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:35:20.049672 15513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Bootstrap starting.
I20260807 00:35:20.053171 15513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:35:20.053465 15513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Bootstrap complete.
I20260807 00:35:20.053766 15513 raft_consensus.cc:348] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } }
I20260807 00:35:20.053897 15513 raft_consensus.cc:729] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b33751849255462fad0d738561cce4f1, State: Initialized, Role: LEARNER
I20260807 00:35:20.053952 15513 consensus_queue.cc:260] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } }
I20260807 00:35:20.054190 15513 sys_catalog.cc:564] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:20.054212 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:20.054464 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: This master's current role is: LEARNER
I20260807 00:35:20.056116 15527 catalog_manager.cc:1259] Loaded cluster ID: 77eb4f7702b84253953b69228d6eaae2
I20260807 00:35:20.056221 15527 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: loading cluster ID for follower catalog manager: success
I20260807 00:35:20.058107 15527 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: acquiring CA information for follower catalog manager: success
I20260807 00:35:20.058447 15527 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 00:35:20.059737 15435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:20.059930 15435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:20.059957 15435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:20.061254 15435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:20.061414 15435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:20.061453 15435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:20.063357 15435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:34807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=35097
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:20.063601 15435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:20.063879 15435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:20.069725 15435 server_base.cc:1034] running on GCE node
W20260807 00:35:20.069820 15532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:20.069888 15533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:20.070057 15535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:20.070322 15435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:20.070616 15435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:20.071841 15435 hybrid_clock.cc:648] HybridClock initialized: now 1786062920071813 us; error 48 us; skew 500 ppm
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:20.075268 15435 init.cc:377] Logged in from keytab as oryx/127.7.252.1@KRBTEST.COM (short username oryx)
I20260807 00:35:20.075917 15435 webserver.cc:460] Webserver started at http://127.7.252.1:35097/ using document root <none> and password file <none>
I20260807 00:35:20.076252 15435 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:20.076351 15435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:20.078464 15435 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:20.079476 15542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.079736 15435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:20.079834 15435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "08f02f7233134c5396e938094a1219a5"
format_stamp: "Formatted at 2026-08-07 00:35:18 on dist-test-slave-csg5"
server_key: "4583ae89b34322ace58e004102d41de0"
server_key_iv: "6a35766e9a8fb3a71ba33a9f51dacdf5"
server_key_version: "encryptionkey@0"
I20260807 00:35:20.080323 15435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:20.098311 15435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:20.101472 15435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:20.101647 15435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:20.101945 15435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:20.102315 15435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:20.102377 15435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.102411 15435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:20.102429 15435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.109810 15435 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:34807
I20260807 00:35:20.109887 15657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:34807 every 8 connection(s)
I20260807 00:35:20.110307 15435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
I20260807 00:35:20.120240 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 15435
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:20.120509 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14867
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.60@KRBTEST.COM
I20260807 00:35:20.125232 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.111432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:44907 (local address 127.7.252.61:35847)
0807 00:35:20.111503 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.111506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.111748 (+ 242us) server_negotiation.cc:407] Connection header received
0807 00:35:20.113036 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.113038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.113051 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.113085 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.114171 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.115116 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.116933 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.117282 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.117349 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.120613 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.120615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.120615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.120626 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.123048 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.123762 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.123764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.123764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.123833 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.124223 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.124225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.124225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.124416 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.124474 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.124956 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.125059 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 00:35:20.126564 15664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.111153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.7.252.1:44907)
0807 00:35:20.111554 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.111600 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.112898 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.113206 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.113211 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.113844 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.114044 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.114051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.115278 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.115279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.116782 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.116785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.117411 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.117412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.117471 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.118352 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.118358 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.120453 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.123156 (+ 2703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.123171 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.123175 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.123642 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.123923 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.123924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.123925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.124108 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.124538 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.124546 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.124759 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.125375 (+ 616us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.126109 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":168,"thread_start_us":103,"threads_started":1}
I20260807 00:35:20.127504 15666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.111153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:46025)
0807 00:35:20.111587 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.111603 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.112843 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.113206 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.113211 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.113830 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.114044 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.114050 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.115430 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.115432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.116824 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.116826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.117320 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.117321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.117466 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.118286 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.118291 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.122369 (+ 4078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.125239 (+ 2870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.125240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.125241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.126299 (+ 1058us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.126615 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.126615 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.126616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.126727 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.127095 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.127097 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.127150 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.127253 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.127386 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":280,"thread_start_us":100,"threads_started":1}
I20260807 00:35:20.127498 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.111437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:46025 (local address 127.7.252.62:44397)
0807 00:35:20.111544 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.111545 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.111724 (+ 179us) server_negotiation.cc:407] Connection header received
0807 00:35:20.112972 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.112974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.112991 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.113056 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.114170 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.115135 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.116931 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.117165 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.117204 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.122522 (+ 5318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.122525 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.122525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.122536 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.125106 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.126427 (+ 1321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.126429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.126429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.126519 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.126791 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.126793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.126793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.126929 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.127025 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.127303 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.127399 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 00:35:20.128633 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.111153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.7.252.1:40907)
0807 00:35:20.111587 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.111603 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.112843 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.113210 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.113213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.113755 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.114042 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.114048 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.115333 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.115335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.116771 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.116774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.117303 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.117304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.117465 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.118212 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.118244 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.122325 (+ 4081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.125176 (+ 2851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.125178 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.125178 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.126230 (+ 1052us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.126551 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.126552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.126553 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.127217 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.128303 (+ 1086us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.128304 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.128350 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.128424 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.128532 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":56,"thread_start_us":106,"threads_started":1}
I20260807 00:35:20.129036 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.111257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:40907 (local address 127.7.252.60:44575)
0807 00:35:20.111463 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.111466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.111771 (+ 305us) server_negotiation.cc:407] Connection header received
0807 00:35:20.113058 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.113059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.113071 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.113167 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.114157 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.115239 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.116866 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.117198 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.117274 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.122488 (+ 5214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.122490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.122491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.122503 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.125028 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.126352 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.126354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.126354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.126452 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.127405 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.127408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.127409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.128101 (+ 692us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.128204 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.128490 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.128624 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":55,"threads_started":1}
I20260807 00:35:20.129838 15659 heartbeater.cc:347] Connected to a master server at 127.7.252.60:44575
I20260807 00:35:20.129990 15659 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.130281 15659 heartbeater.cc:511] Master 127.7.252.60:44575 requested a full tablet report, sending...
I20260807 00:35:20.131237 15661 heartbeater.cc:347] Connected to a master server at 127.7.252.61:35847
I20260807 00:35:20.131296 15661 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.131371 15661 heartbeater.cc:511] Master 127.7.252.61:35847 requested a full tablet report, sending...
I20260807 00:35:20.131825 15282 ts_manager.cc:194] Registered new tserver with Master: 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:20.132141 15473 ts_manager.cc:194] Registered new tserver with Master: 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:20.135412 15660 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44397
I20260807 00:35:20.135525 15660 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.135624 15660 heartbeater.cc:511] Master 127.7.252.62:44397 requested a full tablet report, sending...
I20260807 00:35:20.136037 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:43675
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:44397
--webserver_port=38767
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:35:20.136070 14663 ts_manager.cc:194] Re-registered known tserver with Master: 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:20.136631 14663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:46025
W20260807 00:35:20.232429 15667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:20.232654 15667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:20.232682 15667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:20.233978 15667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:20.234031 15667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:20.234062 15667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:20.235759 15667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:43675
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=38767
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:20.236053 15667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:20.236338 15667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:20.242093 15667 server_base.cc:1034] running on GCE node
W20260807 00:35:20.242018 15673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:20.242019 15675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:20.242018 15672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:20.242584 15667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:20.242938 15667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:20.244104 15667 hybrid_clock.cc:648] HybridClock initialized: now 1786062920244090 us; error 28 us; skew 500 ppm
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:20.247390 15667 init.cc:377] Logged in from keytab as oryx/127.7.252.2@KRBTEST.COM (short username oryx)
I20260807 00:35:20.247939 15667 webserver.cc:460] Webserver started at http://127.7.252.2:38767/ using document root <none> and password file <none>
I20260807 00:35:20.248250 15667 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:20.248342 15667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:20.249907 15667 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:20.250903 15682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.251199 15667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:20.251431 15667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "005b5c1435fb4e03b896893fefbe588b"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "b324167097a83102a7b92afe15661c55"
server_key_iv: "19f20623f7cece5b77a10db53ece9ac5"
server_key_version: "encryptionkey@0"
I20260807 00:35:20.251866 15667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:20.270848 15667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:20.273492 15667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:20.273692 15667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:20.273959 15667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:20.274376 15667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:20.274436 15667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.274480 15667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:20.274507 15667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.281275 15667 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:43675
I20260807 00:35:20.281384 15796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:43675 every 8 connection(s)
I20260807 00:35:20.281790 15667 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:20.283185 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 15667
I20260807 00:35:20.283377 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 15004
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
I20260807 00:35:20.292431 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:34105
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:44397
--webserver_port=40547
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.60@KRBTEST.COM
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:20.297442 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.282831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:48925 (local address 127.7.252.62:44397)
0807 00:35:20.282896 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.282899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.283141 (+ 242us) server_negotiation.cc:407] Connection header received
0807 00:35:20.284738 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.284740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.284754 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.284796 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.286106 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.286965 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.288796 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.289207 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.289257 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.293772 (+ 4515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.293774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.293775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.293784 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.295999 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296556 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.296557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.296558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.296639 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296854 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.296855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.296855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.296998 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.297044 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.297243 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.297342 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 00:35:20.297523 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.283051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:57731 (local address 127.7.252.61:35847)
0807 00:35:20.283103 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.283105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.283369 (+ 264us) server_negotiation.cc:407] Connection header received
0807 00:35:20.284695 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.284697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.284711 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.284739 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.286102 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.286906 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.288758 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.289082 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.289129 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.292821 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.292823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.292823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.292833 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.295425 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296156 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.296158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.296158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.296235 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296522 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.296523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.296524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.296703 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.296770 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.297248 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.297361 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:35:20.297605 15804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.282754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.7.252.2:59603)
0807 00:35:20.283242 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.283254 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.287408 (+ 4154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.287625 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.287626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.287824 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.287886 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.287888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.288831 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.288832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.289615 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.289617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.290084 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.290085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.290147 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.290601 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.290606 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.293115 (+ 2509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.295435 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.295445 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.295448 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.295916 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.296260 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.296261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.296428 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.296907 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.296908 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.297016 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.297129 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.297349 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260807 00:35:20.297793 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.282754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:48925)
0807 00:35:20.283008 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.283055 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.284564 (+ 1509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.284971 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.284976 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.285745 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.285986 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.285993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.287072 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.287073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.288672 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.288675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.289387 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.289388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.289472 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.290634 (+ 1162us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.290640 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.293652 (+ 3012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.296088 (+ 2436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.296089 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.296462 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.296720 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296720 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.296721 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.296778 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.297093 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.297094 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.297132 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.297580 (+ 448us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.297692 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":83,"thread_start_us":106,"threads_started":1}
I20260807 00:35:20.298075 15802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.282754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.7.252.2:57731)
0807 00:35:20.283303 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.283313 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.284579 (+ 1266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.284972 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.284978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.285649 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.285987 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.285993 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.287047 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.287047 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.288654 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.288657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.289263 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.289263 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.289415 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.290356 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.290373 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.292669 (+ 2296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.295500 (+ 2831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.295501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.295502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.296016 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.296317 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.296318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.296429 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.296812 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.296819 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.297017 (+ 198us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.297129 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.297945 (+ 816us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":1078,"thread_start_us":69,"threads_started":1}
I20260807 00:35:20.298162 15799 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44397
I20260807 00:35:20.298280 15799 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.298409 15800 heartbeater.cc:347] Connected to a master server at 127.7.252.61:35847
I20260807 00:35:20.298445 15800 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.298487 15799 heartbeater.cc:511] Master 127.7.252.62:44397 requested a full tablet report, sending...
I20260807 00:35:20.298790 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.282915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:59603 (local address 127.7.252.60:44575)
0807 00:35:20.282967 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.282969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.283332 (+ 363us) server_negotiation.cc:407] Connection header received
0807 00:35:20.287496 (+ 4164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.287498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.287519 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.287568 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.288026 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.288732 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.289721 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.289988 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.290080 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.293232 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.293234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.293234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.293243 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.295328 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296024 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.296025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.296025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.296178 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.296519 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.296520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.296520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.296747 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.296878 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.298546 (+ 1668us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.298647 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:20.298913 14663 ts_manager.cc:194] Re-registered known tserver with Master: 005b5c1435fb4e03b896893fefbe588b (127.7.252.2:43675)
I20260807 00:35:20.298488 15800 heartbeater.cc:511] Master 127.7.252.61:35847 requested a full tablet report, sending...
I20260807 00:35:20.299425 15282 ts_manager.cc:194] Registered new tserver with Master: 005b5c1435fb4e03b896893fefbe588b (127.7.252.2:43675)
I20260807 00:35:20.299425 14663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:48925
I20260807 00:35:20.299573 15797 heartbeater.cc:347] Connected to a master server at 127.7.252.60:44575
I20260807 00:35:20.299628 15797 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.299688 15797 heartbeater.cc:511] Master 127.7.252.60:44575 requested a full tablet report, sending...
I20260807 00:35:20.299973 15473 ts_manager.cc:194] Registered new tserver with Master: 005b5c1435fb4e03b896893fefbe588b (127.7.252.2:43675)
W20260807 00:35:20.390282 15805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:20.390563 15805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:20.390612 15805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:20.392143 15805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:20.392233 15805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:20.392289 15805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:20.394153 15805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:34105
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=40547
--tserver_master_addrs=127.7.252.62:44397,127.7.252.61:35847,127.7.252.60:44575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:20.394505 15805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:20.394869 15805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:20.401019 15813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:20.401044 15810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:20.401163 15805 server_base.cc:1034] running on GCE node
W20260807 00:35:20.401042 15811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:20.401592 15805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:20.401909 15805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:20.403082 15805 hybrid_clock.cc:648] HybridClock initialized: now 1786062920403051 us; error 50 us; skew 500 ppm
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:20.406205 15805 init.cc:377] Logged in from keytab as oryx/127.7.252.3@KRBTEST.COM (short username oryx)
I20260807 00:35:20.406791 15805 webserver.cc:460] Webserver started at http://127.7.252.3:40547/ using document root <none> and password file <none>
I20260807 00:35:20.407070 15805 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:20.407133 15805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:20.408679 15805 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:35:20.409483 15821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.409720 15805 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:20.409821 15805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "2379e2a92ea44b86a3c37f6d59354364"
format_stamp: "Formatted at 2026-08-07 00:35:19 on dist-test-slave-csg5"
server_key: "7d0f30837bb407506e3da431fba01fb3"
server_key_iv: "b5e7edb18ee58c0d287af17a67c8968a"
server_key_version: "encryptionkey@0"
I20260807 00:35:20.410421 15805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:20.413796 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.410362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33112 (local address 127.7.252.60:44575)
0807 00:35:20.410416 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.410418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.410429 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:20.410461 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.410462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.410487 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.410567 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:20.410875 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.411663 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.412747 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.413376 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.413480 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.413558 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.413672 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.413719 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 00:35:20.413822 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.410159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33112)
0807 00:35:20.410270 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.410285 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.410387 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.410616 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.410617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.410620 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:20.410763 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.410765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.411763 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.411764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.412643 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.412646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.413509 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.413510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.413587 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.413592 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.413696 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.413758 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 00:35:20.414242 15486 raft_consensus.cc:1203] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 00:35:20.414462 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90f09e3a6c0f456f9ed288fa60bc13bb. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:20.414572 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: This master's current role is: LEARNER
I20260807 00:35:20.422134 15805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:20.424660 15805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:20.424798 15805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:20.425000 15805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:20.425382 15805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:20.425446 15805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.425484 15805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:20.425551 15805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:20.432720 15805 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:34105
I20260807 00:35:20.432770 15934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:34105 every 8 connection(s)
I20260807 00:35:20.433153 15805 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:20.440580 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 15805
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.61@KRBTEST.COM
Aug 07 00:35:20 dist-test-slave-csg5 krb5kdc[14618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062920, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.60@KRBTEST.COM
I20260807 00:35:20.447613 15939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.433935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.7.252.3:42843)
0807 00:35:20.434268 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.434298 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.434991 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.435633 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.435633 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.436033 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.436203 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.436209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.437187 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.437187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.438383 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.438386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.439175 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.439176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.439268 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.439770 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.439776 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.443318 (+ 3542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.445444 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.445456 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.445459 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.445851 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.446112 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.446113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.446114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.446273 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.446790 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.446799 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.446994 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.447118 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.447328 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":173,"thread_start_us":71,"threads_started":1}
I20260807 00:35:20.447794 15941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.433935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.7.252.3:60923)
0807 00:35:20.434252 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.434298 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.434973 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.435497 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.435505 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.436030 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.436203 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.436209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.438492 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.438493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.439294 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.439296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.439811 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.439812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.439897 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.440357 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.440362 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.443269 (+ 2907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.446260 (+ 2991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.446261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.446261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.446540 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.446790 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.446791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.446791 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.447117 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.447459 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.447460 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.447503 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.447570 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.447685 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":12,"thread_start_us":112,"threads_started":1}
I20260807 00:35:20.448251 15334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.434039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:42843 (local address 127.7.252.61:35847)
0807 00:35:20.434092 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.434094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.434458 (+ 364us) server_negotiation.cc:407] Connection header received
0807 00:35:20.435089 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.435091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.435105 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.435162 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.436325 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.437112 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.438901 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.439088 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.439173 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.443522 (+ 4349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.443524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.443524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.443535 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.445315 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.445954 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.445955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.445956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.446023 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.446471 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.446472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.446473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.446627 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.446770 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.447963 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.448167 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:35:20.448645 15937 heartbeater.cc:347] Connected to a master server at 127.7.252.61:35847
I20260807 00:35:20.448750 15937 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.448761 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.434045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:60923 (local address 127.7.252.60:44575)
0807 00:35:20.434201 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.434203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.434436 (+ 233us) server_negotiation.cc:407] Connection header received
0807 00:35:20.435166 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.435168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.435184 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.435449 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.436324 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.437108 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.439390 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.439720 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.439813 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.443392 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.443394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.443395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.443405 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.446175 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.446626 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.446627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.446627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.446719 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.447210 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.447211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.447212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.447364 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.447430 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.448580 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.448677 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260807 00:35:20.448988 15937 heartbeater.cc:511] Master 127.7.252.61:35847 requested a full tablet report, sending...
I20260807 00:35:20.449255 15935 heartbeater.cc:347] Connected to a master server at 127.7.252.60:44575
I20260807 00:35:20.449314 15935 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.449383 15935 heartbeater.cc:511] Master 127.7.252.60:44575 requested a full tablet report, sending...
I20260807 00:35:20.449753 15473 ts_manager.cc:194] Registered new tserver with Master: 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105)
I20260807 00:35:20.450348 15282 ts_manager.cc:194] Registered new tserver with Master: 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105)
I20260807 00:35:20.451139 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.433981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:56781 (local address 127.7.252.62:44397)
0807 00:35:20.434095 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.434097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.434412 (+ 315us) server_negotiation.cc:407] Connection header received
0807 00:35:20.435446 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.435447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.435462 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.435517 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.436368 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.436881 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.438486 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.438777 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.438841 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.443423 (+ 4582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.443425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.443425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.443434 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.446120 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.449180 (+ 3060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.449182 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.449182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.449592 (+ 410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.450382 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.450384 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.450384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.450535 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.450600 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.450932 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.451031 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 00:35:20.451762 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.433933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:56781)
0807 00:35:20.434252 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.434298 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.434973 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.435526 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.435527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.435985 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:20.436202 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.436207 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.436995 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.436996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.438383 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.438386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.438866 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.438867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.439017 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.439625 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:20.439636 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:20.443306 (+ 3670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:20.446235 (+ 2929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.446237 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.446238 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.449078 (+ 2840us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.449692 (+ 614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:20.449692 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:20.449693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:20.449761 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:20.450709 (+ 948us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:20.450710 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:20.450791 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.451510 (+ 719us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.451647 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":31,"thread_start_us":93,"threads_started":1}
I20260807 00:35:20.452363 15936 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44397
I20260807 00:35:20.452427 15936 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:20.452390 15946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.441936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33124 (local address 127.7.252.60:44575)
0807 00:35:20.442283 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.442286 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.442771 (+ 485us) server_negotiation.cc:407] Connection header received
0807 00:35:20.442946 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.442947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.442963 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.443021 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.443918 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.444754 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.446116 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.446458 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.446506 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.448934 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.448936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.448936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.448945 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.450868 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.451372 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.451373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.451373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.451439 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.451649 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.451650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.451650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.451805 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.451902 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.452146 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.452233 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":66,"threads_started":1}
I20260807 00:35:20.452523 15936 heartbeater.cc:511] Master 127.7.252.62:44397 requested a full tablet report, sending...
I20260807 00:35:20.452782 14663 ts_manager.cc:194] Re-registered known tserver with Master: 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105)
I20260807 00:35:20.453171 14663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:56781
I20260807 00:35:20.454674 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.441995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50382 (local address 127.7.252.62:44397)
0807 00:35:20.443953 (+ 1958us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.443955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.443962 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:35:20.443981 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.443982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.443993 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.444084 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.447049 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.447879 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.449279 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.449599 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.449644 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.451330 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.451332 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.451332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.451339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.453203 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.453618 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.453619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.453619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.453687 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.454012 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.454013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.454013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.454184 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.454295 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.454412 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.454514 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1929,"thread_start_us":130,"threads_started":1}
I20260807 00:35:20.456516 14663 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50382:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:20.459120 14663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:20.459692 15950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.442334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43662 (local address 127.7.252.61:35847)
0807 00:35:20.442485 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.442487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.444627 (+ 2140us) server_negotiation.cc:407] Connection header received
0807 00:35:20.444655 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.444656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.444669 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.444751 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.450613 (+ 5862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.451465 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.453805 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.454114 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.454169 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.456316 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.456318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.456319 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.456329 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.458060 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.458488 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.458490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.458490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.458559 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.458918 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.458919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.458919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.459070 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.459177 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.459453 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.459550 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260807 00:35:20.460003 15434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: NON_VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: true } } }
I20260807 00:35:20.460105 15434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:20.461859 15244 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: attempting to promote NON_VOTER b33751849255462fad0d738561cce4f1 to VOTER
I20260807 00:35:20.462018 15244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } }
I20260807 00:35:20.462555 15292 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Refusing update from remote peer 90f09e3a6c0f456f9ed288fa60bc13bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 00:35:20.462571 15486 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 LEARNER]: Refusing update from remote peer 90f09e3a6c0f456f9ed288fa60bc13bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 00:35:20.462803 15434 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 00:35:20.462913 15244 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 00:35:20.463539 15244 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b33751849255462fad0d738561cce4f1 (127.7.252.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.463757 15486 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b33751849255462fad0d738561cce4f1 (127.7.252.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.464444 15244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.464526 15244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:20.464584 15244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.464648 15244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:20.464715 15244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.464763 15244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:20.464902 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.464890 15292 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b33751849255462fad0d738561cce4f1 (127.7.252.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.464987 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:35:20.466529 15962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:20.466635 15962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:35:20.470312 15961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.465594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34807 (local address 127.0.0.1:52560)
0807 00:35:20.466447 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.466459 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.466515 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.466897 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.466899 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.466902 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:20.466949 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.466950 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.468227 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.468228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.469326 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.469329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.470051 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.470052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.470113 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.470118 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.470166 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.470213 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":19,"thread_start_us":120,"threads_started":1}
I20260807 00:35:20.470312 15964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.466149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52560 (local address 127.7.252.1:34807)
0807 00:35:20.466336 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.466340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.466596 (+ 256us) server_negotiation.cc:407] Connection header received
0807 00:35:20.466765 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.466768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.466789 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.466879 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:20.467024 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.468135 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.469419 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.469952 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.470053 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.470144 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.470187 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.470234 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":79,"threads_started":1}
I20260807 00:35:20.470458 15242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.465476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:34105 (local address 127.0.0.1:46082)
0807 00:35:20.465521 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.465535 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.465584 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.466043 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.466045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.466047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:20.466105 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.466107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.467853 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.467854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.469254 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.469258 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.470221 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.470223 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.470287 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.470292 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.470324 (+ 32us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.470367 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":70}
I20260807 00:35:20.471101 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.465594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46082 (local address 127.7.252.3:34105)
0807 00:35:20.465839 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.465844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.465856 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:35:20.465901 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.465903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.465922 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.466184 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:20.466249 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.467769 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.469357 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.470118 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.470594 (+ 476us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.470721 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.470748 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.470787 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":121,"threads_started":1}
I20260807 00:35:20.471279 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.465806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43675 (local address 127.0.0.1:45114)
0807 00:35:20.466982 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.466993 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.467087 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.467320 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.467321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.467323 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:20.467366 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.467367 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.468421 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.468422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.469496 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.469498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.471039 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.471040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.471092 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.471096 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.471134 (+ 38us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.471166 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1153,"thread_start_us":89,"threads_started":1}
I20260807 00:35:20.471329 15591 tablet_service.cc:1467] Processing CreateTablet for tablet 29b213e104004354b9015e9086d266f6 (DEFAULT_TABLE table=test-table [id=6ec5b2d555de437895ceeb858767e06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:20.471719 15591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b213e104004354b9015e9086d266f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:20.471848 15869 tablet_service.cc:1467] Processing CreateTablet for tablet 29b213e104004354b9015e9086d266f6 (DEFAULT_TABLE table=test-table [id=6ec5b2d555de437895ceeb858767e06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:20.472101 15869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b213e104004354b9015e9086d266f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:20.474740 15966 tablet_bootstrap.cc:492] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Bootstrap starting.
I20260807 00:35:20.474927 15967 tablet_bootstrap.cc:492] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Bootstrap starting.
I20260807 00:35:20.475600 15967 tablet_bootstrap.cc:654] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:20.475660 15966 tablet_bootstrap.cc:654] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:20.475890 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.465940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45114 (local address 127.7.252.2:43675)
0807 00:35:20.466167 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.466172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.467057 (+ 885us) server_negotiation.cc:407] Connection header received
0807 00:35:20.467191 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.467194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.467219 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.467299 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:20.467448 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.468322 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.469585 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.470280 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.470342 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.475423 (+ 5081us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.475460 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.475523 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":84,"threads_started":1}
I20260807 00:35:20.475987 15967 log.cc:824] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:20.476022 15966 log.cc:824] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:20.476758 15966 tablet_bootstrap.cc:492] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: No bootstrap required, opened a new log
I20260807 00:35:20.476635 15730 tablet_service.cc:1467] Processing CreateTablet for tablet 29b213e104004354b9015e9086d266f6 (DEFAULT_TABLE table=test-table [id=6ec5b2d555de437895ceeb858767e06e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:20.476855 15966 ts_tablet_manager.cc:1397] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:20.476884 15967 tablet_bootstrap.cc:492] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: No bootstrap required, opened a new log
I20260807 00:35:20.476941 15967 ts_tablet_manager.cc:1397] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:20.477010 15730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b213e104004354b9015e9086d266f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:20.478938 15966 raft_consensus.cc:348] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.478991 15967 raft_consensus.cc:348] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.479112 15966 raft_consensus.cc:374] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:20.479156 15966 raft_consensus.cc:729] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08f02f7233134c5396e938094a1219a5, State: Initialized, Role: FOLLOWER
I20260807 00:35:20.479161 15967 raft_consensus.cc:374] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:20.479195 15967 raft_consensus.cc:729] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2379e2a92ea44b86a3c37f6d59354364, State: Initialized, Role: FOLLOWER
I20260807 00:35:20.479275 15966 consensus_queue.cc:260] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.479329 15967 consensus_queue.cc:260] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.479609 15967 ts_tablet_manager.cc:1428] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:20.479607 15966 ts_tablet_manager.cc:1428] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:20.479748 15660 heartbeater.cc:503] Master 127.7.252.62:44397 was elected leader, sending a full tablet report...
I20260807 00:35:20.480631 15936 heartbeater.cc:503] Master 127.7.252.62:44397 was elected leader, sending a full tablet report...
I20260807 00:35:20.481756 15972 tablet_bootstrap.cc:492] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Bootstrap starting.
I20260807 00:35:20.482487 15972 tablet_bootstrap.cc:654] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:20.482872 15972 log.cc:824] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:20.483727 15972 tablet_bootstrap.cc:492] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: No bootstrap required, opened a new log
I20260807 00:35:20.483820 15972 ts_tablet_manager.cc:1397] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 00:35:20.485653 15972 raft_consensus.cc:348] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.485826 15972 raft_consensus.cc:374] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:20.485875 15972 raft_consensus.cc:729] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005b5c1435fb4e03b896893fefbe588b, State: Initialized, Role: FOLLOWER
I20260807 00:35:20.486038 15972 consensus_queue.cc:260] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.486410 15799 heartbeater.cc:503] Master 127.7.252.62:44397 was elected leader, sending a full tablet report...
I20260807 00:35:20.486611 15972 ts_tablet_manager.cc:1428] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260807 00:35:20.532778 15801 tablet.cc:2369] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:35:20.611972 15662 tablet.cc:2369] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:35:20.684872 15938 tablet.cc:2369] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:20.720539 15974 raft_consensus.cc:482] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:20.720675 15974 raft_consensus.cc:504] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.721239 15974 leader_election.cc:288] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105), 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:20.725521 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.721457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:34105 (local address 127.7.252.2:37619)
0807 00:35:20.721516 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.721530 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.721591 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.721796 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.721797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.721801 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:20.721912 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.721915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.722947 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.722948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.724368 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.724370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.725179 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.725181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.725280 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.725286 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.725366 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.725422 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":79}
I20260807 00:35:20.725561 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.721578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:37619 (local address 127.7.252.3:34105)
0807 00:35:20.721634 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.721637 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.721645 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:20.721677 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.721678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.721690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.721776 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:20.722004 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.722818 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.724465 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.725020 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.725104 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.725116 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.725406 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.725492 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 00:35:20.725540 15802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.721581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34807 (local address 127.7.252.2:50079)
0807 00:35:20.721655 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:20.721669 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:20.721719 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:20.721922 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:20.721924 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:20.721925 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:20.721986 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.721987 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.722947 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.722948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.724289 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:20.724293 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.725179 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.725181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:20.725381 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.725384 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:20.725439 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 00:35:20.725474 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":48}
I20260807 00:35:20.725613 15964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.721694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:50079 (local address 127.7.252.1:34807)
0807 00:35:20.721782 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.721785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.721794 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:20.721822 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.721823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.721834 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.721888 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:20.722068 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.722818 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.724439 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.725023 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.725104 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.725117 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.725479 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.725535 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 00:35:20.726102 15611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b213e104004354b9015e9086d266f6" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f02f7233134c5396e938094a1219a5" is_pre_election: true
I20260807 00:35:20.726227 15889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b213e104004354b9015e9086d266f6" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2379e2a92ea44b86a3c37f6d59354364" is_pre_election: true
I20260807 00:35:20.726310 15611 raft_consensus.cc:2454] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 0.
I20260807 00:35:20.726357 15889 raft_consensus.cc:2454] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 0.
I20260807 00:35:20.726612 15685 leader_election.cc:302] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005b5c1435fb4e03b896893fefbe588b, 08f02f7233134c5396e938094a1219a5; no voters:
I20260807 00:35:20.726786 15974 raft_consensus.cc:2781] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:20.726850 15974 raft_consensus.cc:482] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:20.726873 15974 raft_consensus.cc:3037] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:20.727636 15974 raft_consensus.cc:504] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.727802 15974 leader_election.cc:288] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 election: Requested vote from peers 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105), 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:20.728012 15611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b213e104004354b9015e9086d266f6" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f02f7233134c5396e938094a1219a5"
I20260807 00:35:20.728045 15889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b213e104004354b9015e9086d266f6" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2379e2a92ea44b86a3c37f6d59354364"
I20260807 00:35:20.728116 15611 raft_consensus.cc:3037] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:20.728137 15889 raft_consensus.cc:3037] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:20.728900 15889 raft_consensus.cc:2454] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 1.
I20260807 00:35:20.728984 15611 raft_consensus.cc:2454] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 1.
I20260807 00:35:20.729151 15684 leader_election.cc:302] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005b5c1435fb4e03b896893fefbe588b, 2379e2a92ea44b86a3c37f6d59354364; no voters:
I20260807 00:35:20.729385 15974 raft_consensus.cc:2781] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:20.729554 15974 raft_consensus.cc:686] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 1 LEADER]: Becoming Leader. State: Replica: 005b5c1435fb4e03b896893fefbe588b, State: Running, Role: LEADER
I20260807 00:35:20.729779 15974 consensus_queue.cc:237] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } }
I20260807 00:35:20.730939 14662 catalog_manager.cc:5495] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b reported cstate change: term changed from 0 to 1, leader changed from <none> to 005b5c1435fb4e03b896893fefbe588b (127.7.252.2). New cstate: current_term: 1 leader_uuid: "005b5c1435fb4e03b896893fefbe588b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } health_report { overall_health: HEALTHY } } }
I20260807 00:35:20.753400 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.751021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45118 (local address 127.7.252.2:43675)
0807 00:35:20.751086 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.751088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.751098 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:20.751144 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.751145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.751165 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.751227 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:20.751434 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.751918 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.752664 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.752867 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.752920 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.753110 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:20.753210 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:20.753273 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.753318 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.753338 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 00:35:20.756115 15889 raft_consensus.cc:1261] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Refusing update from remote peer 005b5c1435fb4e03b896893fefbe588b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:20.756183 15611 raft_consensus.cc:1261] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Refusing update from remote peer 005b5c1435fb4e03b896893fefbe588b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:20.756547 15975 consensus_queue.cc:1035] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:20.756716 15974 consensus_queue.cc:1035] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:20.759800 15978 mvcc.cc:205] Tried to move back new op lower bound from 7315713723413602304 to 7315713723309973504. Current Snapshot: MvccSnapshot[applied={T|T < 7315713723413602304}]
I20260807 00:35:20.760120 15979 mvcc.cc:205] Tried to move back new op lower bound from 7315713723413602304 to 7315713723309973504. Current Snapshot: MvccSnapshot[applied={T|T < 7315713723413602304}]
I20260807 00:35:20.761812 15980 mvcc.cc:205] Tried to move back new op lower bound from 7315713723413602304 to 7315713723309973504. Current Snapshot: MvccSnapshot[applied={T|T < 7315713723413602304 or (T in {7315713723413602304})}]
I20260807 00:35:20.763895 14662 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:20.764047 14662 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:20.765726 14662 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 90f09e3a6c0f456f9ed288fa60bc13bb: Sending DeleteTablet for 3 replicas of tablet 29b213e104004354b9015e9086d266f6
I20260807 00:35:20.766166 15730 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b213e104004354b9015e9086d266f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:20 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:45114
I20260807 00:35:20.766194 15591 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b213e104004354b9015e9086d266f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:20 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:52560
I20260807 00:35:20.766424 15987 tablet_replica.cc:330] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: stopping tablet replica
I20260807 00:35:20.766556 15987 raft_consensus.cc:2229] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:20.766578 15869 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b213e104004354b9015e9086d266f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:20 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:46082
I20260807 00:35:20.766739 15987 raft_consensus.cc:2258] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:20.766776 15988 tablet_replica.cc:330] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: stopping tablet replica
I20260807 00:35:20.766934 15988 raft_consensus.cc:2229] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:20.767046 15988 raft_consensus.cc:2258] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:20.767488 15988 ts_tablet_manager.cc:1905] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:20.767488 15987 ts_tablet_manager.cc:1905] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:20.768488 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 14631
I20260807 00:35:20.769523 15988 ts_tablet_manager.cc:1918] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:20.769596 15988 log.cc:1196] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/29b213e104004354b9015e9086d266f6
I20260807 00:35:20.769861 15988 ts_tablet_manager.cc:1939] T 29b213e104004354b9015e9086d266f6 P 005b5c1435fb4e03b896893fefbe588b: Deleting consensus metadata
I20260807 00:35:20.771981 15987 ts_tablet_manager.cc:1918] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:20.772095 15987 log.cc:1196] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/29b213e104004354b9015e9086d266f6
I20260807 00:35:20.772377 15987 ts_tablet_manager.cc:1939] T 29b213e104004354b9015e9086d266f6 P 08f02f7233134c5396e938094a1219a5: Deleting consensus metadata
I20260807 00:35:20.775101 15989 tablet_replica.cc:330] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: stopping tablet replica
I20260807 00:35:20.775333 15989 raft_consensus.cc:2229] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:20.775532 15989 raft_consensus.cc:2258] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:20.776145 15989 ts_tablet_manager.cc:1905] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:20.777962 15989 ts_tablet_manager.cc:1918] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:20.778120 15989 log.cc:1196] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/29b213e104004354b9015e9086d266f6
W20260807 00:35:20.778246 15685 connection.cc:535] server connection from 127.0.0.1:45114 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 00:35:20.778275 15546 connection.cc:535] server connection from 127.0.0.1:52560 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 00:35:20.778837 15989 ts_tablet_manager.cc:1939] T 29b213e104004354b9015e9086d266f6 P 2379e2a92ea44b86a3c37f6d59354364: Deleting consensus metadata
W20260807 00:35:20.779376 15824 connection.cc:441] server connection from 127.0.0.1:46082 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46082 (request call id 1) could send its response
I20260807 00:35:20.783859 15946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.767868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33128 (local address 127.7.252.60:44575)
0807 00:35:20.767932 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.767934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.774899 (+ 6965us) server_negotiation.cc:407] Connection header received
0807 00:35:20.774988 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.774990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.775011 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.775068 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.775924 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.776649 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.777759 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.778083 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.778138 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.780687 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.780689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.780689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.780710 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.782542 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.782988 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.782989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.782989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.783048 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.783249 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.783250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.783250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.783386 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.783469 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.783651 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.783763 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 00:35:20.789368 15950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.780573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43664 (local address 127.7.252.61:35847)
0807 00:35:20.780621 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.780623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.781014 (+ 391us) server_negotiation.cc:407] Connection header received
0807 00:35:20.781109 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.781111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.781128 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.781164 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.781868 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.782686 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.783790 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.784101 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.784160 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.786025 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.786026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.786027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.786036 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.788223 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.788582 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.788583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.788583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.788643 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.788852 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.788853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.788853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.788972 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.789076 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.789185 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.789278 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:35:20.789508 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:20.780694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33140 (local address 127.7.252.60:44575)
0807 00:35:20.780736 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:20.780738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:20.780887 (+ 149us) server_negotiation.cc:407] Connection header received
0807 00:35:20.780919 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:20.780920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:20.780933 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:20.780999 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:20.781667 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.782496 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.783893 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:20.784225 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:20.784289 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:20.786048 (+ 1759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:20.786049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:20.786050 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:20.786056 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:20.788047 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.788535 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.788537 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.788537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.788602 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:20.788804 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:20.788805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:20.788805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:20.788949 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:20.789063 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:20.789317 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 00:35:20.789402 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:35:21.761969 15999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:21.761568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:50147)
0807 00:35:21.761794 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:21.761902 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":68,"threads_started":1}
W20260807 00:35:21.762255 15660 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:44397 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:21.762437 16000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:21.762116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:57749)
0807 00:35:21.762307 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:21.762386 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":79,"threads_started":1}
I20260807 00:35:21.762619 16001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:21.762355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:46527)
0807 00:35:21.762488 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:21.762574 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":54,"threads_started":1}
W20260807 00:35:21.762639 15936 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:44397 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
W20260807 00:35:21.762825 15799 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:44397 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:22.266156 16002 raft_consensus.cc:482] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90f09e3a6c0f456f9ed288fa60bc13bb)
I20260807 00:35:22.266338 16002 raft_consensus.cc:504] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } }
I20260807 00:35:22.266705 16002 leader_election.cc:288] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397), 6ff2733cb6784698920605222a3bcdf7 (127.7.252.61:35847)
I20260807 00:35:22.267225 16003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.266842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50800)
0807 00:35:22.266963 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.267020 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":49,"threads_started":1}
W20260807 00:35:22.267570 15458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:22.267796 16005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90f09e3a6c0f456f9ed288fa60bc13bb)
I20260807 00:35:22.267935 16005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } }
I20260807 00:35:22.268100 16003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.267993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50812)
0807 00:35:22.268033 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.268071 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260807 00:35:22.268283 15458 leader_election.cc:334] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397): Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:22.268561 16008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.268326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50820)
0807 00:35:22.268461 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.268519 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":63,"threads_started":1}
I20260807 00:35:22.268643 16005 leader_election.cc:288] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397), b33751849255462fad0d738561cce4f1 (127.7.252.60:44575)
W20260807 00:35:22.268685 15267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:22.269201 16008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.269101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50824)
0807 00:35:22.269137 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.269174 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260807 00:35:22.270279 15267 leader_election.cc:334] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397): Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:22.271234 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.267100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43670 (local address 127.7.252.61:35847)
0807 00:35:22.267188 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:22.267190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:22.267197 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:35:22.267232 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:22.267233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:22.267241 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:22.267425 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:22.267585 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.268366 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.269976 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.270873 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.270951 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.270964 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:22.271127 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 00:35:22.271169 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":69,"thread_start_us":40,"threads_started":1}
I20260807 00:35:22.271382 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.266913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35847 (local address 127.0.0.1:43670)
0807 00:35:22.267028 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.267040 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:22.267102 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:22.267434 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:22.267435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:22.267438 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:22.267505 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.267507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.268441 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.268443 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.269873 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.269876 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.270983 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.270984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.271042 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.271046 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:22.271109 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 00:35:22.271151 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":55,"threads_started":1}
I20260807 00:35:22.271663 15292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b33751849255462fad0d738561cce4f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6ff2733cb6784698920605222a3bcdf7" is_pre_election: true
I20260807 00:35:22.271806 15292 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b33751849255462fad0d738561cce4f1 in term 1.
I20260807 00:35:22.271981 15460 leader_election.cc:302] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff2733cb6784698920605222a3bcdf7, b33751849255462fad0d738561cce4f1; no voters: 90f09e3a6c0f456f9ed288fa60bc13bb
I20260807 00:35:22.272111 16002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 00:35:22.272156 16002 raft_consensus.cc:482] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 90f09e3a6c0f456f9ed288fa60bc13bb)
I20260807 00:35:22.272176 16002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 00:35:22.272441 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.268563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:44575 (local address 127.0.0.1:33142)
0807 00:35:22.268727 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.268738 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:22.268794 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:22.268961 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:22.268962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:22.268964 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:22.269019 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.269021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.270056 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.270058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.271482 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.271485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.272194 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.272195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.272263 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.272267 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:22.272324 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:35:22.272369 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":176,"thread_start_us":53,"threads_started":1}
I20260807 00:35:22.272456 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.268702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33142 (local address 127.7.252.60:44575)
0807 00:35:22.268831 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:22.268833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:22.268841 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:22.268861 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:22.268862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:22.268872 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:22.268947 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:22.269128 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.269972 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.271583 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.272060 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.272143 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.272156 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:22.272339 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 00:35:22.272383 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260807 00:35:22.273108 16002 raft_consensus.cc:504] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } }
I20260807 00:35:22.273288 16002 leader_election.cc:288] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [CANDIDATE]: Term 2 election: Requested vote from peers 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397), 6ff2733cb6784698920605222a3bcdf7 (127.7.252.61:35847)
I20260807 00:35:22.273468 15486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ff2733cb6784698920605222a3bcdf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b33751849255462fad0d738561cce4f1" is_pre_election: true
I20260807 00:35:22.273502 15292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b33751849255462fad0d738561cce4f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6ff2733cb6784698920605222a3bcdf7"
I20260807 00:35:22.273563 15292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 00:35:22.273578 15486 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ff2733cb6784698920605222a3bcdf7 in current term 2: Already voted for candidate b33751849255462fad0d738561cce4f1 in this term.
I20260807 00:35:22.273680 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.273521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50832)
0807 00:35:22.273584 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.273618 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 00:35:22.273834 15266 leader_election.cc:302] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ff2733cb6784698920605222a3bcdf7; no voters: 90f09e3a6c0f456f9ed288fa60bc13bb, b33751849255462fad0d738561cce4f1
I20260807 00:35:22.274278 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.274169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50838)
0807 00:35:22.274222 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.274250 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 00:35:22.274401 15458 leader_election.cc:334] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397): Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
I20260807 00:35:22.274471 15292 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b33751849255462fad0d738561cce4f1 in term 2.
I20260807 00:35:22.274580 16005 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:35:22.274684 15460 leader_election.cc:302] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ff2733cb6784698920605222a3bcdf7, b33751849255462fad0d738561cce4f1; no voters: 90f09e3a6c0f456f9ed288fa60bc13bb
I20260807 00:35:22.274829 16002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 00:35:22.274991 16002 raft_consensus.cc:686] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [term 2 LEADER]: Becoming Leader. State: Replica: b33751849255462fad0d738561cce4f1, State: Running, Role: LEADER
I20260807 00:35:22.275048 16002 consensus_queue.cc:237] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } }
I20260807 00:35:22.275410 16012 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b33751849255462fad0d738561cce4f1. Latest consensus state: current_term: 2 leader_uuid: "b33751849255462fad0d738561cce4f1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:22.275513 16012 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:22.275782 16014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:22.276149 16014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:22.276206 16014 catalog_manager.cc:1259] Loaded cluster ID: 77eb4f7702b84253953b69228d6eaae2
I20260807 00:35:22.276224 16014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:22.276445 16014 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:22.276521 16014 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Loaded TSK: 0
I20260807 00:35:22.276631 16014 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:22.288632 15473 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:22.290498 15473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:22.291712 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.291611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50856)
0807 00:35:22.291648 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.291685 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260807 00:35:22.291816 15292 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [term 2 FOLLOWER]: Refusing update from remote peer b33751849255462fad0d738561cce4f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 00:35:22.292091 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.291968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.0.0.1:50862)
0807 00:35:22.292022 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.292044 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 00:35:22.292100 16012 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 00:35:22.292243 15458 consensus_peers.cc:487] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 -> Peer 90f09e3a6c0f456f9ed288fa60bc13bb (127.7.252.62:44397): Couldn't send request to peer 90f09e3a6c0f456f9ed288fa60bc13bb. Status: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 00:35:22.292900 16005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b33751849255462fad0d738561cce4f1. Latest consensus state: current_term: 2 leader_uuid: "b33751849255462fad0d738561cce4f1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:22.293009 16005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:35:22.293393 16015 mvcc.cc:205] Tried to move back new op lower bound from 7315713729704730624 to 7315713729639231488. Current Snapshot: MvccSnapshot[applied={T|T < 7315713729704730624}]
I20260807 00:35:22.293483 16012 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b33751849255462fad0d738561cce4f1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:22.293576 16012 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:22.293676 16005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b33751849255462fad0d738561cce4f1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90f09e3a6c0f456f9ed288fa60bc13bb" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44397 } } peers { permanent_uuid: "6ff2733cb6784698920605222a3bcdf7" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35847 } attrs { promote: false } } peers { permanent_uuid: "b33751849255462fad0d738561cce4f1" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 44575 } attrs { promote: false } } }
I20260807 00:35:22.293785 16005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff2733cb6784698920605222a3bcdf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:35:22.293867 16016 mvcc.cc:205] Tried to move back new op lower bound from 7315713729704730624 to 7315713729639231488. Current Snapshot: MvccSnapshot[applied={T|T < 7315713729704730624 or (T in {7315713729704730624})}]
I20260807 00:35:22.299232 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.295665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43675 (local address 127.0.0.1:45122)
0807 00:35:22.295724 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.295761 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:22.295809 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:22.296198 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:22.296199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:22.296201 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:22.296270 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.296272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.297283 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.297284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.298098 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.298101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.298905 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.298906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.298976 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.298986 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 00:35:22.299062 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 00:35:22.299111 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":67}
I20260807 00:35:22.299202 16024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.295923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45122 (local address 127.7.252.2:43675)
0807 00:35:22.296047 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:22.296049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:22.296057 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:22.296085 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:22.296086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:22.296098 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:22.296340 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:22.296384 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.297173 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.298202 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.298798 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.298882 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.298905 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:22.299070 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 00:35:22.299112 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260807 00:35:22.299252 16003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.295665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:34105 (local address 127.0.0.1:46088)
0807 00:35:22.295931 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.295941 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:22.295993 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:22.296190 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:22.296191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:22.296194 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:22.296257 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.296259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.297019 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.297020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.298111 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.298113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.298984 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.298985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.299049 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.299053 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:22.299084 (+ 31us) client_negotiation.cc:240] Negotiation successful
0807 00:35:22.299130 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":24}
I20260807 00:35:22.299526 16021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.295767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34807 (local address 127.0.0.1:52572)
0807 00:35:22.296184 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.296194 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:22.296241 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:22.296430 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:22.296431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:22.296432 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:22.296463 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.296464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.297356 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.297357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.298437 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:22.298439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.299280 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.299281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:22.299358 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.299362 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:22.299411 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 00:35:22.299463 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":122,"threads_started":1}
I20260807 00:35:22.299582 16020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.295811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46088 (local address 127.7.252.3:34105)
0807 00:35:22.296053 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:22.296055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:22.296062 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:35:22.296089 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:22.296089 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:22.296101 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:22.296404 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:22.296440 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.296936 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.298259 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.298859 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.299425 (+ 566us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.299439 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:22.299458 (+ 19us) server_negotiation.cc:299] Negotiation successful
0807 00:35:22.299497 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":63,"threads_started":1}
I20260807 00:35:22.299752 16023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.295906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52572 (local address 127.7.252.1:34807)
0807 00:35:22.296130 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:22.296132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:22.296292 (+ 160us) server_negotiation.cc:407] Connection header received
0807 00:35:22.296321 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:22.296322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:22.296333 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:22.296388 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:22.296528 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.297271 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.298531 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.299174 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.299237 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.299248 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:22.299620 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 00:35:22.299671 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":59,"threads_started":1}
I20260807 00:35:22.299784 15869 tablet_service.cc:1467] Processing CreateTablet for tablet 01bff2c99f734937babf9a355d24c065 (DEFAULT_TABLE table=test-table [id=9018b23776a54f3b8ba9721145951bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:22.299932 15869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01bff2c99f734937babf9a355d24c065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:22.299926 15730 tablet_service.cc:1467] Processing CreateTablet for tablet 01bff2c99f734937babf9a355d24c065 (DEFAULT_TABLE table=test-table [id=9018b23776a54f3b8ba9721145951bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:22.300031 15730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01bff2c99f734937babf9a355d24c065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:22.300033 15591 tablet_service.cc:1467] Processing CreateTablet for tablet 01bff2c99f734937babf9a355d24c065 (DEFAULT_TABLE table=test-table [id=9018b23776a54f3b8ba9721145951bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:22.300161 15591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01bff2c99f734937babf9a355d24c065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:22.301558 16027 tablet_bootstrap.cc:492] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5: Bootstrap starting.
I20260807 00:35:22.301724 16026 tablet_bootstrap.cc:492] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Bootstrap starting.
I20260807 00:35:22.301981 16027 tablet_bootstrap.cc:654] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:22.302093 16026 tablet_bootstrap.cc:654] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:22.302424 16025 tablet_bootstrap.cc:492] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Bootstrap starting.
I20260807 00:35:22.302697 16027 tablet_bootstrap.cc:492] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5: No bootstrap required, opened a new log
I20260807 00:35:22.302755 16027 ts_tablet_manager.cc:1397] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:22.302770 16026 tablet_bootstrap.cc:492] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: No bootstrap required, opened a new log
I20260807 00:35:22.302821 16026 ts_tablet_manager.cc:1397] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:22.302904 16025 tablet_bootstrap.cc:654] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:22.302925 16027 raft_consensus.cc:348] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.302942 16026 raft_consensus.cc:348] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.303006 16027 raft_consensus.cc:374] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:22.303020 16026 raft_consensus.cc:374] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:22.303035 16027 raft_consensus.cc:729] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08f02f7233134c5396e938094a1219a5, State: Initialized, Role: FOLLOWER
I20260807 00:35:22.303043 16026 raft_consensus.cc:729] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2379e2a92ea44b86a3c37f6d59354364, State: Initialized, Role: FOLLOWER
I20260807 00:35:22.303084 16027 consensus_queue.cc:260] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.303176 16026 consensus_queue.cc:260] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.303254 16027 ts_tablet_manager.cc:1428] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:22.303392 16026 ts_tablet_manager.cc:1428] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:22.303998 15659 heartbeater.cc:503] Master 127.7.252.60:44575 was elected leader, sending a full tablet report...
I20260807 00:35:22.304112 16025 tablet_bootstrap.cc:492] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: No bootstrap required, opened a new log
I20260807 00:35:22.304169 16025 ts_tablet_manager.cc:1397] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:35:22.304253 15935 heartbeater.cc:503] Master 127.7.252.60:44575 was elected leader, sending a full tablet report...
I20260807 00:35:22.304296 16025 raft_consensus.cc:348] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.304374 16025 raft_consensus.cc:374] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:22.304406 16025 raft_consensus.cc:729] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005b5c1435fb4e03b896893fefbe588b, State: Initialized, Role: FOLLOWER
I20260807 00:35:22.304447 16025 consensus_queue.cc:260] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.304593 16025 ts_tablet_manager.cc:1428] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 00:35:22.305023 16034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.304246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:56357)
0807 00:35:22.304936 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.304978 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":91,"threads_started":1}
I20260807 00:35:22.305197 15797 heartbeater.cc:503] Master 127.7.252.60:44575 was elected leader, sending a full tablet report...
I20260807 00:35:22.305444 16033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.303545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:36223)
0807 00:35:22.304755 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.305395 (+ 640us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1173,"thread_start_us":86,"threads_started":1}
I20260807 00:35:22.305573 16034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.305368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:38815)
0807 00:35:22.305513 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.305541 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260807 00:35:22.305876 16038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.305665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:42499)
0807 00:35:22.305806 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.305837 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":95,"threads_started":1}
I20260807 00:35:22.305886 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.304905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:57189)
0807 00:35:22.305829 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.305860 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":904,"thread_start_us":78,"threads_started":1}
I20260807 00:35:22.436789 16035 raft_consensus.cc:482] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:22.436903 16035 raft_consensus.cc:504] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.437130 16035 leader_election.cc:288] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105), 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:22.437495 15889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01bff2c99f734937babf9a355d24c065" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2379e2a92ea44b86a3c37f6d59354364" is_pre_election: true
I20260807 00:35:22.437506 15611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01bff2c99f734937babf9a355d24c065" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f02f7233134c5396e938094a1219a5" is_pre_election: true
I20260807 00:35:22.437597 15889 raft_consensus.cc:2454] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 0.
I20260807 00:35:22.437620 15611 raft_consensus.cc:2454] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 0.
I20260807 00:35:22.437847 15685 leader_election.cc:302] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005b5c1435fb4e03b896893fefbe588b, 08f02f7233134c5396e938094a1219a5; no voters:
I20260807 00:35:22.437955 16035 raft_consensus.cc:2781] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:22.438030 16035 raft_consensus.cc:482] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:22.438066 16035 raft_consensus.cc:3037] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:22.438942 16035 raft_consensus.cc:504] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.439123 16035 leader_election.cc:288] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 election: Requested vote from peers 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105), 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807)
I20260807 00:35:22.439363 15611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01bff2c99f734937babf9a355d24c065" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f02f7233134c5396e938094a1219a5"
I20260807 00:35:22.439471 15611 raft_consensus.cc:3037] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:22.439446 15889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01bff2c99f734937babf9a355d24c065" candidate_uuid: "005b5c1435fb4e03b896893fefbe588b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2379e2a92ea44b86a3c37f6d59354364"
I20260807 00:35:22.439569 15889 raft_consensus.cc:3037] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:22.440222 15611 raft_consensus.cc:2454] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 1.
I20260807 00:35:22.440237 15889 raft_consensus.cc:2454] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005b5c1435fb4e03b896893fefbe588b in term 1.
I20260807 00:35:22.440448 15684 leader_election.cc:302] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005b5c1435fb4e03b896893fefbe588b, 2379e2a92ea44b86a3c37f6d59354364; no voters:
I20260807 00:35:22.440544 16035 raft_consensus.cc:2781] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:22.440781 16035 raft_consensus.cc:686] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 1 LEADER]: Becoming Leader. State: Replica: 005b5c1435fb4e03b896893fefbe588b, State: Running, Role: LEADER
I20260807 00:35:22.440876 16035 consensus_queue.cc:237] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } }
I20260807 00:35:22.441274 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.441126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:58327)
0807 00:35:22.441165 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.441232 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260807 00:35:22.441735 15472 catalog_manager.cc:5495] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b reported cstate change: term changed from 0 to 1, leader changed from <none> to 005b5c1435fb4e03b896893fefbe588b (127.7.252.2). New cstate: current_term: 1 leader_uuid: "005b5c1435fb4e03b896893fefbe588b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005b5c1435fb4e03b896893fefbe588b" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:22.484347 16024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.481598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45136 (local address 127.7.252.2:43675)
0807 00:35:22.481699 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:22.481701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:22.481712 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:22.481742 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:22.481743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:22.481756 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:22.481840 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:22.481989 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.482579 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.483480 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:22.483723 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:22.483824 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:22.484006 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:22.484052 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:22.484130 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:22.484211 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 00:35:22.484240 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 00:35:22.485828 15889 raft_consensus.cc:1261] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Refusing update from remote peer 005b5c1435fb4e03b896893fefbe588b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:22.485865 15611 raft_consensus.cc:1261] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Refusing update from remote peer 005b5c1435fb4e03b896893fefbe588b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:22.486102 16039 consensus_queue.cc:1035] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2379e2a92ea44b86a3c37f6d59354364" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:22.486403 16039 consensus_queue.cc:1035] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08f02f7233134c5396e938094a1219a5" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:22.487073 16034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.486877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:50739)
0807 00:35:22.486990 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.487027 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 00:35:22.487460 16038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.487361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:38129)
0807 00:35:22.487397 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.487427 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260807 00:35:22.488953 16034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.488849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.3:51667)
0807 00:35:22.488891 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.488918 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 00:35:22.489023 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.488927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:36811)
0807 00:35:22.488968 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.488991 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 00:35:22.490715 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.490314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.2:44119)
0807 00:35:22.490611 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.490675 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280}
I20260807 00:35:22.490880 16038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.490759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44397 (local address 127.7.252.1:54133)
0807 00:35:22.490816 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.490841 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 00:35:22.491451 15472 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:22.491560 15472 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:22.493180 15472 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b33751849255462fad0d738561cce4f1: Sending DeleteTablet for 3 replicas of tablet 01bff2c99f734937babf9a355d24c065
I20260807 00:35:22.493546 15869 tablet_service.cc:1514] Processing DeleteTablet for tablet 01bff2c99f734937babf9a355d24c065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:22 UTC) from {username='oryx', principal='oryx/127.7.252.60@KRBTEST.COM'} at 127.0.0.1:46088
I20260807 00:35:22.493577 15591 tablet_service.cc:1514] Processing DeleteTablet for tablet 01bff2c99f734937babf9a355d24c065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:22 UTC) from {username='oryx', principal='oryx/127.7.252.60@KRBTEST.COM'} at 127.0.0.1:52572
I20260807 00:35:22.493690 15730 tablet_service.cc:1514] Processing DeleteTablet for tablet 01bff2c99f734937babf9a355d24c065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:22 UTC) from {username='oryx', principal='oryx/127.7.252.60@KRBTEST.COM'} at 127.0.0.1:45122
I20260807 00:35:22.493808 16053 tablet_replica.cc:330] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: stopping tablet replica
I20260807 00:35:22.493875 16053 raft_consensus.cc:2229] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:22.493929 16053 raft_consensus.cc:2258] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:22.494064 16052 tablet_replica.cc:330] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5: stopping tablet replica
I20260807 00:35:22.494102 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 15435
I20260807 00:35:22.494145 16052 raft_consensus.cc:2229] T 01bff2c99f734937babf9a355d24c065 P 08f02f7233134c5396e938094a1219a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:22.495517 16053 ts_tablet_manager.cc:1905] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:22.495926 16054 tablet_replica.cc:330] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: stopping tablet replica
I20260807 00:35:22.495981 16054 raft_consensus.cc:2229] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:22.496042 16054 raft_consensus.cc:2258] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:22.496356 16054 ts_tablet_manager.cc:1905] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:22.497581 16053 ts_tablet_manager.cc:1918] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:22.497651 16053 log.cc:1196] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/01bff2c99f734937babf9a355d24c065
I20260807 00:35:22.497888 16053 ts_tablet_manager.cc:1939] T 01bff2c99f734937babf9a355d24c065 P 2379e2a92ea44b86a3c37f6d59354364: Deleting consensus metadata
I20260807 00:35:22.498205 16054 ts_tablet_manager.cc:1918] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:22.498272 16054 log.cc:1196] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/01bff2c99f734937babf9a355d24c065
I20260807 00:35:22.498344 15458 catalog_manager.cc:4841] TS 2379e2a92ea44b86a3c37f6d59354364 (127.7.252.3:34105): tablet 01bff2c99f734937babf9a355d24c065 (table test-table [id=9018b23776a54f3b8ba9721145951bf1]) successfully deleted
I20260807 00:35:22.498522 16054 ts_tablet_manager.cc:1939] T 01bff2c99f734937babf9a355d24c065 P 005b5c1435fb4e03b896893fefbe588b: Deleting consensus metadata
I20260807 00:35:22.499106 15459 catalog_manager.cc:4841] TS 005b5c1435fb4e03b896893fefbe588b (127.7.252.2:43675): tablet 01bff2c99f734937babf9a355d24c065 (table test-table [id=9018b23776a54f3b8ba9721145951bf1]) successfully deleted
I20260807 00:35:22.502087 16021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:22.501939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34807 (local address 127.0.0.1:52586)
0807 00:35:22.502010 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:22.502042 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:34807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 00:35:22.502146 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 15667
W20260807 00:35:22.502310 15459 catalog_manager.cc:4584] TS 08f02f7233134c5396e938094a1219a5 (127.7.252.1:34807): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 01bff2c99f734937babf9a355d24c065: Network error: Client connection negotiation failed: client connection to 127.7.252.1:34807: connect: Connection refused (error 111)
I20260807 00:35:22.510524 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 15805
I20260807 00:35:22.516866 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 15142
I20260807 00:35:22.523384 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 15337
2026-08-07T00:35:22Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5174 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:22 dist-test-slave-csg5 krb5kdc[16057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:22 dist-test-slave-csg5 krb5kdc[16057](info): set up 2 sockets
Aug 07 00:35:22 dist-test-slave-csg5 krb5kdc[16057](info): commencing operation
krb5kdc: starting...
W20260807 00:35:23.643793 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:23 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:23Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab.
Entry for principal oryx/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab.
I20260807 00:35:23.782016 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44101
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab
--principal=oryx/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:23.866714 16071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:23.866976 16071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:23.867015 16071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:23.868217 16071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:23.868292 16071 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 00:35:23.868317 16071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:23.868359 16071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:23.868391 16071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:23.868418 16071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:23.870013 16071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44101
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.62.keytab
--principal=oryx/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:23.870311 16071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:23.870568 16071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:23.875768 16079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:23.875731 16076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:23.875744 16077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:23.876040 16071 server_base.cc:1034] running on GCE node
I20260807 00:35:23.876278 16071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:23.876608 16071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:23.877768 16071 hybrid_clock.cc:648] HybridClock initialized: now 1786062923877751 us; error 33 us; skew 500 ppm
Aug 07 00:35:23 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062923, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:23.884276 16071 init.cc:377] Logged in from keytab as oryx/127.7.252.62@KRBTEST.COM (short username oryx)
I20260807 00:35:23.884794 16071 webserver.cc:460] Webserver started at http://127.7.252.62:37409/ using document root <none> and password file <none>
I20260807 00:35:23.885067 16071 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:23.885159 16071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:23.885332 16071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:23.886493 16071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "61cb1c0852884f908a084156089712e5"
format_stamp: "Formatted at 2026-08-07 00:35:23 on dist-test-slave-csg5"
server_key: "1085dc9389a1b5cf8737f0cfcb90cd22"
server_key_iv: "f125e772b4a97f8ad3f0c15bcd7b6519"
server_key_version: "encryptionkey@0"
I20260807 00:35:23.886909 16071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "61cb1c0852884f908a084156089712e5"
format_stamp: "Formatted at 2026-08-07 00:35:23 on dist-test-slave-csg5"
server_key: "1085dc9389a1b5cf8737f0cfcb90cd22"
server_key_iv: "f125e772b4a97f8ad3f0c15bcd7b6519"
server_key_version: "encryptionkey@0"
I20260807 00:35:23.888478 16071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:23.889361 16086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:23.889580 16071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:23.889696 16071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "61cb1c0852884f908a084156089712e5"
format_stamp: "Formatted at 2026-08-07 00:35:23 on dist-test-slave-csg5"
server_key: "1085dc9389a1b5cf8737f0cfcb90cd22"
server_key_iv: "f125e772b4a97f8ad3f0c15bcd7b6519"
server_key_version: "encryptionkey@0"
I20260807 00:35:23.889777 16071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:23.913117 16071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:23.915571 16071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:23.915751 16071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:23.921219 16071 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44101
I20260807 00:35:23.921265 16152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44101 every 8 connection(s)
I20260807 00:35:23.921633 16071 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:23.922312 16153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:23.925199 16153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Bootstrap starting.
I20260807 00:35:23.925897 16153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:23.926230 16153 log.cc:824] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:23.927050 16153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: No bootstrap required, opened a new log
I20260807 00:35:23.928339 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16071
I20260807 00:35:23.928436 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:23.928692 8176 external_mini_cluster.cc:1428] Setting key 3aaff6b9a38b9fe5ad1ddae5e1bae708
I20260807 00:35:23.929976 16153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61cb1c0852884f908a084156089712e5" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44101 } }
I20260807 00:35:23.930150 16153 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:23.930194 16153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61cb1c0852884f908a084156089712e5, State: Initialized, Role: FOLLOWER
I20260807 00:35:23.930349 16153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61cb1c0852884f908a084156089712e5" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44101 } }
I20260807 00:35:23.930447 16153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:23.930492 16153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:23.930565 16153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:23.931191 16153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61cb1c0852884f908a084156089712e5" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44101 } }
I20260807 00:35:23.931320 16153 leader_election.cc:302] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61cb1c0852884f908a084156089712e5; no voters:
I20260807 00:35:23.931519 16153 leader_election.cc:288] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:23.931553 16158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:23.931679 16158 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [term 1 LEADER]: Becoming Leader. State: Replica: 61cb1c0852884f908a084156089712e5, State: Running, Role: LEADER
I20260807 00:35:23.931762 16158 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61cb1c0852884f908a084156089712e5" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44101 } }
I20260807 00:35:23.931811 16153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:23.933096 16160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61cb1c0852884f908a084156089712e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61cb1c0852884f908a084156089712e5" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44101 } } }
I20260807 00:35:23.933197 16160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:23.933382 16159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61cb1c0852884f908a084156089712e5. Latest consensus state: current_term: 1 leader_uuid: "61cb1c0852884f908a084156089712e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61cb1c0852884f908a084156089712e5" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44101 } } }
I20260807 00:35:23.933418 16174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:23.933573 16159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:23.934060 16174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:23.935715 16174 catalog_manager.cc:1347] Generated new cluster ID: a010309beccb4330a4e9ef5742979ffa
I20260807 00:35:23.935781 16174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:35:23 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:23.941893 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:23.929426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.7.252.62:44101)
0807 00:35:23.929625 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:23.929634 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:23.929668 (+ 34us) server_negotiation.cc:407] Connection header received
0807 00:35:23.929954 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:23.929961 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:23.930011 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:23.930153 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:23.930982 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:23.932267 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:23.933482 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:23.934010 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:23.934148 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:23.937285 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:23.937290 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:23.937290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:23.937304 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:23.939495 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:23.939957 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:23.939960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:23.939961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:23.940093 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:23.940326 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:23.940327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:23.940327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:23.940752 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:23.940928 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:23.941473 (+ 545us) server_negotiation.cc:299] Negotiation successful
0807 00:35:23.941633 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260807 00:35:23.947568 16174 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:23.948372 16174 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:23.952527 16174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Generated new TSK 0
I20260807 00:35:23.952729 16174 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab.
Entry for principal oryx/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab.
I20260807 00:35:23.995174 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44101
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:24.098874 16179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:24.099128 16179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:24.099177 16179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:24.100407 16179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:24.100477 16179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:24.100514 16179 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:35:24.100553 16179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:24.102208 16179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:44101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:24.102499 16179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:24.102763 16179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:24.108567 16179 server_base.cc:1034] running on GCE node
W20260807 00:35:24.108532 16184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:24.108532 16185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:24.108532 16187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:24.109169 16179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:24.109486 16179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:24.110766 16179 hybrid_clock.cc:648] HybridClock initialized: now 1786062924110731 us; error 53 us; skew 500 ppm
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:24.113643 16179 init.cc:377] Logged in from keytab as oryx/127.7.252.1@KRBTEST.COM (short username oryx)
I20260807 00:35:24.114172 16179 webserver.cc:460] Webserver started at http://127.7.252.1:43813/ using document root <none> and password file <none>
I20260807 00:35:24.114493 16179 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:24.114570 16179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:24.114764 16179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:24.115991 16179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "aee2f700ad324545a12a3244505ca240"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "dadc85daedbee05016d0000ed13bac7f"
server_key_iv: "8ed6ea9571ed5e99cbaa66fe32d531a3"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.116375 16179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "aee2f700ad324545a12a3244505ca240"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "dadc85daedbee05016d0000ed13bac7f"
server_key_iv: "8ed6ea9571ed5e99cbaa66fe32d531a3"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.117908 16179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:24.118898 16194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.119148 16179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:24.119267 16179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "aee2f700ad324545a12a3244505ca240"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "dadc85daedbee05016d0000ed13bac7f"
server_key_iv: "8ed6ea9571ed5e99cbaa66fe32d531a3"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.119374 16179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:24.149072 16179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:24.151474 16179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:24.151656 16179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:24.152220 16179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:24.152292 16179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.152351 16179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:24.152377 16179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:24.159755 16179 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:34777
I20260807 00:35:24.159869 16311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:34777 every 8 connection(s)
I20260807 00:35:24.160209 16179 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:24.162703 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16179
I20260807 00:35:24.162856 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:24.163105 8176 external_mini_cluster.cc:1428] Setting key f0f6aff0c794ca7a3cfa2a24fb118655
I20260807 00:35:24.163749 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.152837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:33793 (local address 127.7.252.62:44101)
0807 00:35:24.152917 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.152920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.153085 (+ 165us) server_negotiation.cc:407] Connection header received
0807 00:35:24.153631 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.153632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.153651 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.153733 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.154749 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.155639 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.156838 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.157217 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.157296 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.159979 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.159981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.159981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.159993 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.161757 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.162180 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.162181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.162182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.162303 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.162760 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.162762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.162762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.162968 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.163057 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.163443 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.163592 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:35:24.163761 16203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.152765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.7.252.1:33793)
0807 00:35:24.152943 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.152985 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.153524 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.153849 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.153853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.154261 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:24.154573 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.154580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.155746 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.155753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.156704 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.156707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.157338 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.157340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.157487 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.158093 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:24.158102 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:24.159866 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:24.161854 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.161862 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.161864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.162093 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.162413 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.162413 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.162414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.162584 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.163064 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:24.163073 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:24.163263 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.163385 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.163589 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260807 00:35:24.164561 16312 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44101
I20260807 00:35:24.164673 16312 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:24.164875 16312 heartbeater.cc:511] Master 127.7.252.62:44101 requested a full tablet report, sending...
I20260807 00:35:24.165473 16102 ts_manager.cc:194] Registered new tserver with Master: aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777)
I20260807 00:35:24.166153 16102 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:33793
I20260807 00:35:24.173892 16319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.166404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.7.252.1:55317)
0807 00:35:24.166570 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.166583 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.166634 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.166869 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.166870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.167078 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:24.167148 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.167150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.168029 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.168030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.168948 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.168951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.169514 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.169515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.169599 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.170304 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:24.170309 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:24.170619 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:24.172771 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.172772 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.172773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.172950 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.173180 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.173181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.173181 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.173235 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.173547 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:24.173548 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:24.173601 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.173658 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.173786 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260807 00:35:24.173950 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.166648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:55317 (local address 127.7.252.62:44101)
0807 00:35:24.166728 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.166730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.166743 (+ 13us) server_negotiation.cc:407] Connection header received
0807 00:35:24.166771 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.166772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.166784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.166853 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.167240 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.167915 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.169065 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.169423 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.169491 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.170815 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.170817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.170817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.170826 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.172630 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.173039 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.173040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.173041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.173104 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.173301 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.173302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.173302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.173472 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.173553 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.173720 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.173842 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for oryx/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab.
Entry for principal oryx/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab.
I20260807 00:35:24.197822 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44101
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:24.283540 16321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:24.283762 16321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:24.283789 16321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:24.284942 16321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:24.284984 16321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:24.285004 16321 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:35:24.285022 16321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:24.286604 16321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:44101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:24.286888 16321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:24.287086 16321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:24.292564 16327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:24.292634 16329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:24.292836 16326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:24.292661 16321 server_base.cc:1034] running on GCE node
I20260807 00:35:24.293103 16321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:24.293448 16321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:24.294646 16321 hybrid_clock.cc:648] HybridClock initialized: now 1786062924294631 us; error 35 us; skew 500 ppm
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:24.297952 16321 init.cc:377] Logged in from keytab as oryx/127.7.252.2@KRBTEST.COM (short username oryx)
I20260807 00:35:24.298456 16321 webserver.cc:460] Webserver started at http://127.7.252.2:41775/ using document root <none> and password file <none>
I20260807 00:35:24.298763 16321 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:24.298842 16321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:24.299005 16321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:24.300124 16321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "c70b3591c394406dbec833ac27e449b6"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "31cbe0d195e249e3f5f3512a96e2753c"
server_key_iv: "b01a6989b5b39f3b1f0b6e31635efa53"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.300588 16321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "c70b3591c394406dbec833ac27e449b6"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "31cbe0d195e249e3f5f3512a96e2753c"
server_key_iv: "b01a6989b5b39f3b1f0b6e31635efa53"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.302146 16321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:24.303056 16336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.303244 16321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:24.303355 16321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "c70b3591c394406dbec833ac27e449b6"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "31cbe0d195e249e3f5f3512a96e2753c"
server_key_iv: "b01a6989b5b39f3b1f0b6e31635efa53"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.303444 16321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:24.324566 16321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:24.327173 16321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:24.327301 16321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:24.327804 16321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:24.327847 16321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.327874 16321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:24.327915 16321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.335626 16321 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:34689
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:24.335718 16454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:34689 every 8 connection(s)
I20260807 00:35:24.336035 16321 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:24.339391 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.328451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:43709 (local address 127.7.252.62:44101)
0807 00:35:24.328516 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.328518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.328915 (+ 397us) server_negotiation.cc:407] Connection header received
0807 00:35:24.329695 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.329697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.329714 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.329801 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.330882 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.331580 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.332878 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.333204 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.333300 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.336246 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.336248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.336248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.336257 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.337754 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.338202 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.338203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.338204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.338270 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.338599 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.338600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.338601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.338778 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.338873 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.339177 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.339273 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 00:35:24.339596 16345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.328489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.7.252.2:43709)
0807 00:35:24.328717 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.328761 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.329545 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.329923 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.329929 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.330364 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:24.330746 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.330754 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.331688 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.331689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.332757 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.332760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.333390 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.333391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.333530 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.334176 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:24.334187 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:24.336148 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:24.337854 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.337861 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.337864 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.338116 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.338394 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.338396 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.338396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.338522 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.338862 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:24.338869 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:24.339027 (+ 158us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.339149 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.339331 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":88,"threads_started":1}
I20260807 00:35:24.340206 16455 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44101
I20260807 00:35:24.340377 16455 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:24.340591 16455 heartbeater.cc:511] Master 127.7.252.62:44101 requested a full tablet report, sending...
I20260807 00:35:24.341143 16103 ts_manager.cc:194] Registered new tserver with Master: c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689)
I20260807 00:35:24.341611 16103 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:43709
I20260807 00:35:24.344221 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16321
I20260807 00:35:24.344383 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:24.344622 8176 external_mini_cluster.cc:1428] Setting key 1be1cafbbfc863c9dfd97b00bcc85f16
I20260807 00:35:24.347849 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.341481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.7.252.2:47929)
0807 00:35:24.341626 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.341638 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.341705 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.341860 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.341861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.342073 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:24.342134 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.342136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.342931 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.342931 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.343458 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.343460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.343855 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.343856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.343928 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.344426 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:24.344434 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:24.344731 (+ 297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:24.346565 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.346566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.346567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.346827 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.347054 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.347055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.347055 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.347118 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.347449 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:24.347450 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:24.347501 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.347581 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.347705 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260807 00:35:24.347848 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.341545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:47929 (local address 127.7.252.62:44101)
0807 00:35:24.341593 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.341596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.341709 (+ 113us) server_negotiation.cc:407] Connection header received
0807 00:35:24.341778 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.341779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.341790 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.341855 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.342240 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.342834 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.343548 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.343758 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.343852 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.344842 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.344843 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.344844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.344850 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.346460 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.346915 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.346917 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.346917 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.346979 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.347192 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.347193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.347194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.347364 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.347444 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.347621 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.347704 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab.
Entry for principal oryx/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab.
I20260807 00:35:24.378926 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44101
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:24.464732 16464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:24.464965 16464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:24.465018 16464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:24.466292 16464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:24.466351 16464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:24.466377 16464 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 00:35:24.466395 16464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:24.468050 16464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.252.62:44101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:24.468286 16464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:24.468487 16464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:24.474625 16469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:24.474608 16470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:24.474608 16472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:24.474998 16464 server_base.cc:1034] running on GCE node
I20260807 00:35:24.475219 16464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:24.475476 16464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:24.476662 16464 hybrid_clock.cc:648] HybridClock initialized: now 1786062924476646 us; error 27 us; skew 500 ppm
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:24.479821 16464 init.cc:377] Logged in from keytab as oryx/127.7.252.3@KRBTEST.COM (short username oryx)
I20260807 00:35:24.480381 16464 webserver.cc:460] Webserver started at http://127.7.252.3:45329/ using document root <none> and password file <none>
I20260807 00:35:24.480641 16464 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:24.480713 16464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:24.480877 16464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:24.482035 16464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "dca265eb24bea10e9ed75274b7d0adc1"
server_key_iv: "5b1007bb8e92ba90f0139fddfa5788a4"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.482437 16464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "dca265eb24bea10e9ed75274b7d0adc1"
server_key_iv: "5b1007bb8e92ba90f0139fddfa5788a4"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.484055 16464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:24.485373 16479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.485680 16464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:24.485841 16464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
format_stamp: "Formatted at 2026-08-07 00:35:24 on dist-test-slave-csg5"
server_key: "dca265eb24bea10e9ed75274b7d0adc1"
server_key_iv: "5b1007bb8e92ba90f0139fddfa5788a4"
server_key_version: "encryptionkey@0"
I20260807 00:35:24.485939 16464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:24.507053 16464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:24.509727 16464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:24.509862 16464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:24.510398 16464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:24.510478 16464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.510532 16464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:24.510561 16464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.518067 16464 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:39349
I20260807 00:35:24.518144 16595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:39349 every 8 connection(s)
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:24.518545 16464 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:24.522248 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.510962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:39141 (local address 127.7.252.62:44101)
0807 00:35:24.511005 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.511008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.511313 (+ 305us) server_negotiation.cc:407] Connection header received
0807 00:35:24.511857 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.511858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.511873 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.511948 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.512904 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.513888 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.515622 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.515989 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.516112 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.519010 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.519011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.519012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.519021 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.520560 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.521032 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.521033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.521033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.521087 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.521337 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.521338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.521338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.521456 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.521514 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.522079 (+ 565us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.522174 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:35:24.522428 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.510947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.7.252.3:39141)
0807 00:35:24.511132 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.511170 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.511738 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.512052 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.512055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.512458 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:24.512775 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.512781 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.514007 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.514008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.515514 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.515517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.516110 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.516111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.516214 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.516864 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:24.516876 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:24.518850 (+ 1974us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:24.520666 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.520674 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.520676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.520950 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.521153 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.521153 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.521154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.521275 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.521548 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:24.521556 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:24.521811 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.521990 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.522187 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
I20260807 00:35:24.523039 16596 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44101
I20260807 00:35:24.523167 16596 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:24.523371 16596 heartbeater.cc:511] Master 127.7.252.62:44101 requested a full tablet report, sending...
I20260807 00:35:24.523918 16102 ts_manager.cc:194] Registered new tserver with Master: 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:24.524456 16102 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:39141
I20260807 00:35:24.525184 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16464
I20260807 00:35:24.525295 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:24.525579 8176 external_mini_cluster.cc:1428] Setting key f6884fc10e948b24b4fd785e9dfa87eb
I20260807 00:35:24.526499 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:35:24.532027 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.524862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:51807 (local address 127.7.252.62:44101)
0807 00:35:24.524918 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.524920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.525057 (+ 137us) server_negotiation.cc:407] Connection header received
0807 00:35:24.525132 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.525133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.525155 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.525213 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.525611 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.526207 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.527280 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.527620 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.527691 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.528946 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.528948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.528948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.528957 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.530624 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.531129 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.531130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.531131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.531189 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.531431 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.531432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.531432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.531547 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.531603 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.531845 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.531952 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:24.532152 16602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.524769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.7.252.3:51807)
0807 00:35:24.524977 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.524988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.525070 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.525215 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.525216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.525464 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:24.525525 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.525528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.526299 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.526300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.527158 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.527162 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.527714 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.527716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.527806 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.528325 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:24.528331 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:24.528839 (+ 508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:24.530767 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.530768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.530769 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.531048 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.531261 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:24.531262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:24.531263 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:24.531366 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:24.531620 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:24.531621 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:24.531697 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.531786 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.531972 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":123,"threads_started":1}
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
W20260807 00:35:24.552343 16157 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:24.546216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.7.252.62:44101)
0807 00:35:24.546295 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.546298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.546308 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:24.546338 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.546339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.546349 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.546413 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.547080 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.547589 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.548435 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.548622 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.548713 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.552227 (+ 3514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51542: BlockingRecv error: recv got EOF from 127.0.0.1:51542 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 00:35:24 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062924, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:24.561398 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.553195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51552 (local address 127.7.252.62:44101)
0807 00:35:24.553295 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.553297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.553307 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:24.553341 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.553341 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.553350 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.553403 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:24.553907 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.554397 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.555281 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.555485 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.555550 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.558433 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:24.558434 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:24.558434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:24.558441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:24.560085 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.560513 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.560515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.560515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.560577 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:24.560841 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:24.560842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:24.560842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:24.560982 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:24.561074 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.561201 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.561276 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 00:35:24.563481 16102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:24.565681 16102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:24.573627 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.568896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.0.0.1:33032)
0807 00:35:24.569275 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.569288 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.569364 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.569804 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.569805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.569807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:24.569851 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.569852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.571146 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.571147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.572322 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.572325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.573229 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.573230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.573333 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.573352 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.573445 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.573522 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":63,"thread_start_us":121,"threads_started":1}
I20260807 00:35:24.573648 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.569283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.7.252.1:34777)
0807 00:35:24.569574 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.569578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.569586 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:24.569625 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.569627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.569643 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.569719 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:24.569929 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.571058 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.572426 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.573123 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.573203 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.573299 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.573473 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.573523 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":108,"threads_started":1}
I20260807 00:35:24.574039 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.568777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:34689 (local address 127.0.0.1:37558)
0807 00:35:24.569080 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.569128 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.569204 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.569531 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.569534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.569537 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:24.569617 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.569619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.571098 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.571098 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.572651 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.572655 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.573682 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.573683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.573773 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.573778 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.573870 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.573928 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":129,"thread_start_us":104,"threads_started":1}
I20260807 00:35:24.574117 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.569291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32992 (local address 127.7.252.3:39349)
0807 00:35:24.569707 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.569712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.569723 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:24.569765 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.569768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.569786 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.569880 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:24.570049 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.570897 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.572759 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.573491 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.573559 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.573637 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.573981 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.574022 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":101,"threads_started":1}
I20260807 00:35:24.574286 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.569055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:39349 (local address 127.0.0.1:32992)
0807 00:35:24.569492 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.569526 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.569578 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.569891 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.569892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.569895 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:24.569948 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.569950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.570993 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.570994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.572653 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.572655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.573679 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.573680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.573747 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.573752 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.573825 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.573905 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":80,"thread_start_us":84,"threads_started":1}
I20260807 00:35:24.574343 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.568966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.7.252.2:34689)
0807 00:35:24.569164 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.569169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.569180 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:24.569345 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.569348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.569366 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.569438 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:24.569708 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.571009 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.572788 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.573492 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.573558 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.573639 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.574159 (+ 520us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.574216 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":101,"threads_started":1}
I20260807 00:35:24.575136 16244 tablet_service.cc:1467] Processing CreateTablet for tablet 45cb3c33156344f58db7ff79d4a59a36 (DEFAULT_TABLE table=test-table [id=b71040b768494da79b42222015efa97b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:24.575157 16388 tablet_service.cc:1467] Processing CreateTablet for tablet 45cb3c33156344f58db7ff79d4a59a36 (DEFAULT_TABLE table=test-table [id=b71040b768494da79b42222015efa97b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:24.575115 16529 tablet_service.cc:1467] Processing CreateTablet for tablet 45cb3c33156344f58db7ff79d4a59a36 (DEFAULT_TABLE table=test-table [id=b71040b768494da79b42222015efa97b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:24.575536 16244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cb3c33156344f58db7ff79d4a59a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:24.575536 16388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cb3c33156344f58db7ff79d4a59a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:24.575536 16529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cb3c33156344f58db7ff79d4a59a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:24.579561 16624 tablet_bootstrap.cc:492] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Bootstrap starting.
I20260807 00:35:24.579967 16625 tablet_bootstrap.cc:492] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Bootstrap starting.
I20260807 00:35:24.580629 16624 tablet_bootstrap.cc:654] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:24.580654 16625 tablet_bootstrap.cc:654] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:24.581033 16625 log.cc:824] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:24.581033 16624 log.cc:824] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:24.581439 16626 tablet_bootstrap.cc:492] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Bootstrap starting.
I20260807 00:35:24.582046 16625 tablet_bootstrap.cc:492] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: No bootstrap required, opened a new log
I20260807 00:35:24.582139 16624 tablet_bootstrap.cc:492] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: No bootstrap required, opened a new log
I20260807 00:35:24.582139 16625 ts_tablet_manager.cc:1397] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:24.582206 16626 tablet_bootstrap.cc:654] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:24.582219 16624 ts_tablet_manager.cc:1397] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:35:24.582576 16626 log.cc:824] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:24.583534 16626 tablet_bootstrap.cc:492] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: No bootstrap required, opened a new log
I20260807 00:35:24.583621 16626 ts_tablet_manager.cc:1397] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:35:24.584038 16624 raft_consensus.cc:348] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.584203 16624 raft_consensus.cc:374] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:24.584245 16624 raft_consensus.cc:729] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee2f700ad324545a12a3244505ca240, State: Initialized, Role: FOLLOWER
I20260807 00:35:24.584368 16624 consensus_queue.cc:260] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.584672 16624 ts_tablet_manager.cc:1428] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 00:35:24.584677 16312 heartbeater.cc:503] Master 127.7.252.62:44101 was elected leader, sending a full tablet report...
I20260807 00:35:24.584583 16625 raft_consensus.cc:348] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.584748 16625 raft_consensus.cc:374] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:24.584784 16625 raft_consensus.cc:729] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f169c4216884ac7b1ffaa9adf9890d3, State: Initialized, Role: FOLLOWER
I20260807 00:35:24.584911 16625 consensus_queue.cc:260] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.585228 16625 ts_tablet_manager.cc:1428] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 00:35:24.585403 16596 heartbeater.cc:503] Master 127.7.252.62:44101 was elected leader, sending a full tablet report...
I20260807 00:35:24.586187 16626 raft_consensus.cc:348] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.586398 16626 raft_consensus.cc:374] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:24.586453 16626 raft_consensus.cc:729] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70b3591c394406dbec833ac27e449b6, State: Initialized, Role: FOLLOWER
I20260807 00:35:24.586588 16626 consensus_queue.cc:260] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.586896 16626 ts_tablet_manager.cc:1428] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 00:35:24.586966 16455 heartbeater.cc:503] Master 127.7.252.62:44101 was elected leader, sending a full tablet report...
W20260807 00:35:24.661121 16313 tablet.cc:2369] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:35:24.769261 16597 tablet.cc:2369] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:24.790248 16630 raft_consensus.cc:482] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:24.790438 16630 raft_consensus.cc:504] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.790984 16630 leader_election.cc:288] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:24.795780 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.791656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:33271 (local address 127.7.252.3:39349)
0807 00:35:24.791716 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.791718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.791726 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:24.791758 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.791759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.791771 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.791828 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:24.792057 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.792854 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.794557 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.795282 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.795358 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.795370 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.795638 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.795688 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 00:35:24.795789 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.791429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:47341 (local address 127.7.252.2:34689)
0807 00:35:24.791519 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.791521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.791576 (+ 55us) server_negotiation.cc:407] Connection header received
0807 00:35:24.791690 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.791692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.791706 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.791782 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:24.792038 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.792808 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.794558 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.795232 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.795334 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.795355 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.795638 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.795726 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 00:35:24.795842 16633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.791302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:34689 (local address 127.7.252.1:47341)
0807 00:35:24.791445 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.791490 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.791600 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.791802 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.791803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.791806 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:24.791918 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.791920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.792951 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.792953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.794418 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.794422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.795420 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.795421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.795530 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.795539 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.795604 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.795716 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":125,"thread_start_us":84,"threads_started":1}
I20260807 00:35:24.795852 16634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.791528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:39349 (local address 127.7.252.1:33271)
0807 00:35:24.791651 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:24.791662 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:24.791712 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:24.791836 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:24.791837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:24.791838 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:24.791917 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.791920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.792957 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.792958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.794418 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:24.794422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.795418 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.795420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:24.795530 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.795538 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 00:35:24.795604 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 00:35:24.795716 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":127,"thread_start_us":48,"threads_started":1}
I20260807 00:35:24.796355 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cb3c33156344f58db7ff79d4a59a36" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" is_pre_election: true
I20260807 00:35:24.796352 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cb3c33156344f58db7ff79d4a59a36" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6" is_pre_election: true
I20260807 00:35:24.796530 16549 raft_consensus.cc:2454] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 0.
I20260807 00:35:24.796553 16408 raft_consensus.cc:2454] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 0.
I20260807 00:35:24.796790 16198 leader_election.cc:302] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:24.796990 16630 raft_consensus.cc:2781] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:24.797073 16630 raft_consensus.cc:482] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:24.797092 16630 raft_consensus.cc:3037] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:24.798064 16630 raft_consensus.cc:504] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.798211 16630 leader_election.cc:288] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 election: Requested vote from peers c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:24.798416 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cb3c33156344f58db7ff79d4a59a36" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
I20260807 00:35:24.798493 16549 raft_consensus.cc:3037] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:24.798770 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cb3c33156344f58db7ff79d4a59a36" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6"
I20260807 00:35:24.798920 16408 raft_consensus.cc:3037] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:24.799369 16549 raft_consensus.cc:2454] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 1.
I20260807 00:35:24.799552 16198 leader_election.cc:302] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:24.799669 16630 raft_consensus.cc:2781] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:24.799808 16630 raft_consensus.cc:686] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 1 LEADER]: Becoming Leader. State: Replica: aee2f700ad324545a12a3244505ca240, State: Running, Role: LEADER
I20260807 00:35:24.799808 16408 raft_consensus.cc:2454] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 1.
I20260807 00:35:24.799919 16630 consensus_queue.cc:237] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } }
I20260807 00:35:24.800850 16102 catalog_manager.cc:5495] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee2f700ad324545a12a3244505ca240 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } health_report { overall_health: HEALTHY } } }
W20260807 00:35:24.836894 16456 tablet.cc:2369] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:35:24.859409 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:24.856785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.7.252.1:34777)
0807 00:35:24.856853 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:24.856855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:24.856864 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:24.856914 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:24.856915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:24.856936 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:24.857018 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:24.857175 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.857713 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.858523 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:24.858768 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:24.858847 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:24.859044 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:24.859150 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:24.859248 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:24.859285 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 00:35:24.859315 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:35:24.861601 16549 raft_consensus.cc:1261] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Refusing update from remote peer aee2f700ad324545a12a3244505ca240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:24.861613 16408 raft_consensus.cc:1261] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Refusing update from remote peer aee2f700ad324545a12a3244505ca240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:24.861984 16630 consensus_queue.cc:1035] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:24.862160 16635 consensus_queue.cc:1035] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:24.864509 16638 mvcc.cc:205] Tried to move back new op lower bound from 7315713740229537792 to 7315713739981135872. Current Snapshot: MvccSnapshot[applied={T|T < 7315713740229537792}]
I20260807 00:35:24.865363 16639 mvcc.cc:205] Tried to move back new op lower bound from 7315713740229537792 to 7315713739981135872. Current Snapshot: MvccSnapshot[applied={T|T < 7315713740229537792 or (T in {7315713740229537792})}]
I20260807 00:35:24.867774 16103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:24.867874 16103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:24.868682 16103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Sending DeleteTablet for 3 replicas of tablet 45cb3c33156344f58db7ff79d4a59a36
I20260807 00:35:24.869012 16388 tablet_service.cc:1514] Processing DeleteTablet for tablet 45cb3c33156344f58db7ff79d4a59a36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:24 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:37558
I20260807 00:35:24.869086 16529 tablet_service.cc:1514] Processing DeleteTablet for tablet 45cb3c33156344f58db7ff79d4a59a36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:24 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:32992
I20260807 00:35:24.869256 16244 tablet_service.cc:1514] Processing DeleteTablet for tablet 45cb3c33156344f58db7ff79d4a59a36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:24 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:33032
I20260807 00:35:24.869318 16647 tablet_replica.cc:330] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: stopping tablet replica
I20260807 00:35:24.869431 16647 raft_consensus.cc:2229] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:24.869542 16647 raft_consensus.cc:2258] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:24.869540 16103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:24.869704 16103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:24.870097 16648 tablet_replica.cc:330] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: stopping tablet replica
I20260807 00:35:24.870247 16648 raft_consensus.cc:2229] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:24.870401 16648 raft_consensus.cc:2258] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:24.870445 16647 ts_tablet_manager.cc:1905] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:24.870608 16649 tablet_replica.cc:330] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: stopping tablet replica
I20260807 00:35:24.871026 16648 ts_tablet_manager.cc:1905] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:24.871584 16529 tablet_service.cc:1467] Processing CreateTablet for tablet 6906df5219c44e659936faac9d295adb (DEFAULT_TABLE table=test-table [id=70aa141e568041d2962b4d07251262f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:24.871721 16529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6906df5219c44e659936faac9d295adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:24.872511 16647 ts_tablet_manager.cc:1918] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:24.872599 16647 log.cc:1196] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/45cb3c33156344f58db7ff79d4a59a36
I20260807 00:35:24.872876 16648 ts_tablet_manager.cc:1918] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:24.872972 16648 log.cc:1196] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/45cb3c33156344f58db7ff79d4a59a36
I20260807 00:35:24.873042 16625 tablet_bootstrap.cc:492] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Bootstrap starting.
I20260807 00:35:24.873266 16648 ts_tablet_manager.cc:1939] T 45cb3c33156344f58db7ff79d4a59a36 P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting consensus metadata
I20260807 00:35:24.873289 16388 tablet_service.cc:1467] Processing CreateTablet for tablet 6906df5219c44e659936faac9d295adb (DEFAULT_TABLE table=test-table [id=70aa141e568041d2962b4d07251262f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:24.873421 16388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6906df5219c44e659936faac9d295adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:24.873478 16625 tablet_bootstrap.cc:654] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:24.873616 16649 raft_consensus.cc:2229] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:24.873795 16647 ts_tablet_manager.cc:1939] T 45cb3c33156344f58db7ff79d4a59a36 P c70b3591c394406dbec833ac27e449b6: Deleting consensus metadata
I20260807 00:35:24.873944 16649 raft_consensus.cc:2258] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:24.874446 16625 tablet_bootstrap.cc:492] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: No bootstrap required, opened a new log
I20260807 00:35:24.874467 16649 ts_tablet_manager.cc:1905] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:24.874500 16625 ts_tablet_manager.cc:1397] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:24.874640 16626 tablet_bootstrap.cc:492] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Bootstrap starting.
I20260807 00:35:24.874686 16625 raft_consensus.cc:348] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:24.874769 16625 raft_consensus.cc:374] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:24.874799 16625 raft_consensus.cc:729] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f169c4216884ac7b1ffaa9adf9890d3, State: Initialized, Role: FOLLOWER
I20260807 00:35:24.874840 16625 consensus_queue.cc:260] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:24.874933 16625 ts_tablet_manager.cc:1428] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:24.875048 16626 tablet_bootstrap.cc:654] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:24.875545 16090 catalog_manager.cc:4841] TS c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689): tablet 45cb3c33156344f58db7ff79d4a59a36 (table test-table [id=b71040b768494da79b42222015efa97b]) successfully deleted
I20260807 00:35:24.875694 16090 catalog_manager.cc:4841] TS 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349): tablet 45cb3c33156344f58db7ff79d4a59a36 (table test-table [id=b71040b768494da79b42222015efa97b]) successfully deleted
I20260807 00:35:24.876099 16244 tablet_service.cc:1467] Processing CreateTablet for tablet 6906df5219c44e659936faac9d295adb (DEFAULT_TABLE table=test-table [id=70aa141e568041d2962b4d07251262f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:24.876688 16649 ts_tablet_manager.cc:1918] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:24.876706 16626 tablet_bootstrap.cc:492] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: No bootstrap required, opened a new log
I20260807 00:35:24.876747 16626 ts_tablet_manager.cc:1397] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:35:24.876716 16244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6906df5219c44e659936faac9d295adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:24.876928 16649 log.cc:1196] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/45cb3c33156344f58db7ff79d4a59a36
I20260807 00:35:24.877112 16626 raft_consensus.cc:348] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:24.877211 16626 raft_consensus.cc:374] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:24.877241 16626 raft_consensus.cc:729] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70b3591c394406dbec833ac27e449b6, State: Initialized, Role: FOLLOWER
I20260807 00:35:24.877285 16626 consensus_queue.cc:260] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:24.877411 16626 ts_tablet_manager.cc:1428] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:24.877434 16649 ts_tablet_manager.cc:1939] T 45cb3c33156344f58db7ff79d4a59a36 P aee2f700ad324545a12a3244505ca240: Deleting consensus metadata
I20260807 00:35:24.878162 16087 catalog_manager.cc:4841] TS aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777): tablet 45cb3c33156344f58db7ff79d4a59a36 (table test-table [id=b71040b768494da79b42222015efa97b]) successfully deleted
I20260807 00:35:24.878206 16624 tablet_bootstrap.cc:492] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Bootstrap starting.
I20260807 00:35:24.878623 16624 tablet_bootstrap.cc:654] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:24.879413 16624 tablet_bootstrap.cc:492] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: No bootstrap required, opened a new log
I20260807 00:35:24.879469 16624 ts_tablet_manager.cc:1397] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:24.879614 16624 raft_consensus.cc:348] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:24.879688 16624 raft_consensus.cc:374] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:24.879707 16624 raft_consensus.cc:729] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee2f700ad324545a12a3244505ca240, State: Initialized, Role: FOLLOWER
I20260807 00:35:24.879747 16624 consensus_queue.cc:260] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:24.879835 16624 ts_tablet_manager.cc:1428] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 00:35:25.017241 16631 raft_consensus.cc:482] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:25.017414 16631 raft_consensus.cc:504] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.017861 16631 leader_election.cc:288] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777), c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689)
I20260807 00:35:25.021323 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.018114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.7.252.3:33137)
0807 00:35:25.018179 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.018194 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.018254 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.018405 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.018406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.018409 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:25.018490 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.018492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.019358 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.019359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.020386 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.020389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.020973 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.020974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.021062 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.021066 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.021135 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.021187 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 00:35:25.021375 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.018187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:33137 (local address 127.7.252.1:34777)
0807 00:35:25.018253 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.018256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.018270 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:35:25.018314 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.018315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.018326 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.018399 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:25.018588 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.019180 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.020491 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.020881 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.020936 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.020945 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.021149 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.021197 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 00:35:25.021400 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.018282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:47085 (local address 127.7.252.2:34689)
0807 00:35:25.018371 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.018374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.018420 (+ 46us) server_negotiation.cc:407] Connection header received
0807 00:35:25.018494 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.018496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.018506 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.018567 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:25.018815 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.019413 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.020496 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.020986 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.021064 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.021075 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.021264 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.021314 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 00:35:25.021668 16654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.018118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:34689 (local address 127.7.252.3:47085)
0807 00:35:25.018358 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.018369 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.018430 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.018586 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.018587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.018589 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:25.018697 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.018698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.019510 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.019511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.020385 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.020387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.021090 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.021091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.021175 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.021179 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.021238 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.021276 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":66,"thread_start_us":103,"threads_started":1}
I20260807 00:35:25.021709 16265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6906df5219c44e659936faac9d295adb" candidate_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee2f700ad324545a12a3244505ca240" is_pre_election: true
I20260807 00:35:25.021884 16265 raft_consensus.cc:2454] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f169c4216884ac7b1ffaa9adf9890d3 in term 0.
I20260807 00:35:25.022070 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6906df5219c44e659936faac9d295adb" candidate_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6" is_pre_election: true
I20260807 00:35:25.022084 16480 leader_election.cc:302] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:25.022163 16408 raft_consensus.cc:2454] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f169c4216884ac7b1ffaa9adf9890d3 in term 0.
I20260807 00:35:25.022250 16631 raft_consensus.cc:2781] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:25.022313 16631 raft_consensus.cc:482] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:25.022337 16631 raft_consensus.cc:3037] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.023250 16631 raft_consensus.cc:504] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.023401 16631 leader_election.cc:288] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [CANDIDATE]: Term 1 election: Requested vote from peers aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777), c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689)
I20260807 00:35:25.023610 16265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6906df5219c44e659936faac9d295adb" candidate_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee2f700ad324545a12a3244505ca240"
I20260807 00:35:25.023707 16265 raft_consensus.cc:3037] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.023675 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6906df5219c44e659936faac9d295adb" candidate_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6"
I20260807 00:35:25.023770 16408 raft_consensus.cc:3037] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.024556 16265 raft_consensus.cc:2454] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f169c4216884ac7b1ffaa9adf9890d3 in term 1.
I20260807 00:35:25.024765 16480 leader_election.cc:302] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:25.024775 16408 raft_consensus.cc:2454] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f169c4216884ac7b1ffaa9adf9890d3 in term 1.
I20260807 00:35:25.024873 16631 raft_consensus.cc:2781] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:25.024991 16631 raft_consensus.cc:686] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7f169c4216884ac7b1ffaa9adf9890d3, State: Running, Role: LEADER
I20260807 00:35:25.025081 16631 consensus_queue.cc:237] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.025926 16103 catalog_manager.cc:5495] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } health_report { overall_health: HEALTHY } } }
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062923, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.62@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:25.091934 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.083478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44101 (local address 127.0.0.1:51564)
0807 00:35:25.083595 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.083607 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.083690 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.083886 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.083887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.084313 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:25.084372 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.084375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.085130 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.085131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.085850 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.085853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.086318 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.086319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.086374 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.087031 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:25.087036 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:25.088764 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:25.090600 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:25.090610 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:25.090613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:25.090930 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:25.091187 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:25.091187 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:25.091188 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:25.091257 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:25.091601 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:25.091609 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:25.091658 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.091719 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.091836 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":49,"threads_started":1}
I20260807 00:35:25.092090 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.083543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51564 (local address 127.7.252.62:44101)
0807 00:35:25.083696 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.083698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.083713 (+ 15us) server_negotiation.cc:407] Connection header received
0807 00:35:25.083742 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.083742 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.083753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.083835 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:25.084486 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.085030 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.085938 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.086153 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.086211 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.088866 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:25.088868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:25.088868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:25.088876 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:25.090478 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:25.091014 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:25.091015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:25.091015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:25.091077 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:25.091398 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:25.091399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:25.091399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:25.091525 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:25.091588 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.091757 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.091921 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260807 00:35:25.094640 16103 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:51564:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 00:35:25.094987 16103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:25.096732 16244 tablet_service.cc:1467] Processing CreateTablet for tablet db0c3f1cda204e45b63cd16f0991bddc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52a6ac21dcdb41869b449ddff978d441]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:35:25.096776 16529 tablet_service.cc:1467] Processing CreateTablet for tablet db0c3f1cda204e45b63cd16f0991bddc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52a6ac21dcdb41869b449ddff978d441]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:35:25.096781 16388 tablet_service.cc:1467] Processing CreateTablet for tablet db0c3f1cda204e45b63cd16f0991bddc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52a6ac21dcdb41869b449ddff978d441]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 00:35:25.096928 16244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0c3f1cda204e45b63cd16f0991bddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.096947 16529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0c3f1cda204e45b63cd16f0991bddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.096974 16388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0c3f1cda204e45b63cd16f0991bddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.098264 16626 tablet_bootstrap.cc:492] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: Bootstrap starting.
I20260807 00:35:25.098452 16625 tablet_bootstrap.cc:492] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: Bootstrap starting.
I20260807 00:35:25.098803 16626 tablet_bootstrap.cc:654] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.098869 16625 tablet_bootstrap.cc:654] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.099105 16624 tablet_bootstrap.cc:492] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: Bootstrap starting.
I20260807 00:35:25.099483 16624 tablet_bootstrap.cc:654] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.099524 16625 tablet_bootstrap.cc:492] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: No bootstrap required, opened a new log
I20260807 00:35:25.099576 16625 ts_tablet_manager.cc:1397] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:25.099725 16625 raft_consensus.cc:348] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.099812 16625 raft_consensus.cc:374] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.099841 16625 raft_consensus.cc:729] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f169c4216884ac7b1ffaa9adf9890d3, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.099876 16626 tablet_bootstrap.cc:492] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: No bootstrap required, opened a new log
I20260807 00:35:25.099884 16625 consensus_queue.cc:260] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.099942 16626 ts_tablet_manager.cc:1397] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:35:25.099984 16625 ts_tablet_manager.cc:1428] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.100095 16626 raft_consensus.cc:348] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.100207 16626 raft_consensus.cc:374] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.100232 16626 raft_consensus.cc:729] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70b3591c394406dbec833ac27e449b6, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.100292 16626 consensus_queue.cc:260] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.100399 16626 ts_tablet_manager.cc:1428] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.100467 16632 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.100567 16632 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.100544 16631 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.100632 16631 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.100919 16624 tablet_bootstrap.cc:492] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: No bootstrap required, opened a new log
I20260807 00:35:25.100978 16624 ts_tablet_manager.cc:1397] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:35:25.101097 16624 raft_consensus.cc:348] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.101179 16624 raft_consensus.cc:374] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.101217 16624 raft_consensus.cc:729] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee2f700ad324545a12a3244505ca240, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.101271 16624 consensus_queue.cc:260] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.101383 16624 ts_tablet_manager.cc:1428] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.101405 16635 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.101506 16635 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.229389 16635 raft_consensus.cc:482] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:25.229548 16635 raft_consensus.cc:504] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.229773 16635 leader_election.cc:288] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:25.230068 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0c3f1cda204e45b63cd16f0991bddc" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" is_pre_election: true
I20260807 00:35:25.230177 16549 raft_consensus.cc:2454] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 0.
I20260807 00:35:25.230098 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0c3f1cda204e45b63cd16f0991bddc" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6" is_pre_election: true
I20260807 00:35:25.230264 16408 raft_consensus.cc:2454] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 0.
I20260807 00:35:25.230367 16198 leader_election.cc:302] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:25.230499 16635 raft_consensus.cc:2781] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:25.230552 16635 raft_consensus.cc:482] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:25.230568 16635 raft_consensus.cc:3037] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.231447 16635 raft_consensus.cc:504] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.231576 16635 leader_election.cc:288] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 election: Requested vote from peers c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:25.231843 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0c3f1cda204e45b63cd16f0991bddc" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
I20260807 00:35:25.231923 16549 raft_consensus.cc:3037] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.232573 16549 raft_consensus.cc:2454] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 1.
I20260807 00:35:25.232780 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0c3f1cda204e45b63cd16f0991bddc" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6"
I20260807 00:35:25.232879 16408 raft_consensus.cc:3037] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.232892 16198 leader_election.cc:302] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:25.232995 16635 raft_consensus.cc:2781] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:25.233039 16635 raft_consensus.cc:686] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [term 1 LEADER]: Becoming Leader. State: Replica: aee2f700ad324545a12a3244505ca240, State: Running, Role: LEADER
I20260807 00:35:25.233108 16635 consensus_queue.cc:237] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.233386 16630 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: TxnStatusTablet state changed. Reason: New leader aee2f700ad324545a12a3244505ca240. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.233482 16630 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:35:25.233834 16408 raft_consensus.cc:2454] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 1.
I20260807 00:35:25.233850 16668 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 00:35:25.233987 16668 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 00:35:25.233995 16102 catalog_manager.cc:5495] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee2f700ad324545a12a3244505ca240 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:25.249801 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.246885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33062 (local address 127.7.252.1:34777)
0807 00:35:25.246940 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.246982 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.247017 (+ 35us) server_negotiation.cc:407] Connection header received
0807 00:35:25.247043 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.247044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.247057 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.247105 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.247290 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.247872 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.249039 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.249257 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.249323 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.249548 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.249584 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.249627 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.249707 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.249729 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:35:25.249853 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.246807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.0.0.1:33062)
0807 00:35:25.246901 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.246913 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.246961 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.247131 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.247132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.247134 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:25.247212 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.247216 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.247957 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.247958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.248933 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.248936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.249342 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.249343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.249431 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.249457 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.249647 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.249656 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.249706 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.249764 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 00:35:25.251154 16549 raft_consensus.cc:1261] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Refusing update from remote peer aee2f700ad324545a12a3244505ca240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.251154 16408 raft_consensus.cc:1261] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Refusing update from remote peer aee2f700ad324545a12a3244505ca240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.251483 16635 consensus_queue.cc:1035] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.251617 16630 consensus_queue.cc:1035] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.252305 16631 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: TxnStatusTablet state changed. Reason: New leader aee2f700ad324545a12a3244505ca240. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.252345 16632 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: TxnStatusTablet state changed. Reason: New leader aee2f700ad324545a12a3244505ca240. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.252421 16631 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.252437 16632 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.253119 16635 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.253211 16635 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:35:25.253365 16631 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.253477 16631 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P 7f169c4216884ac7b1ffaa9adf9890d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.254074 16630 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.254156 16630 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P aee2f700ad324545a12a3244505ca240: This TxnStatusTablet replica's current role is: LEADER
I20260807 00:35:25.254623 16643 mvcc.cc:205] Tried to move back new op lower bound from 7315713741826191360 to 7315713741755150336. Current Snapshot: MvccSnapshot[applied={T|T < 7315713741826191360 or (T in {7315713741826191360})}]
I20260807 00:35:25.254803 16632 tablet_replica.cc:439] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } } }
I20260807 00:35:25.254902 16632 tablet_replica.cc:442] T db0c3f1cda204e45b63cd16f0991bddc P c70b3591c394406dbec833ac27e449b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 00:35:25.258386 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.255358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.7.252.3:39349)
0807 00:35:25.255404 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.255406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.255414 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:25.255452 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.255453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.255474 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.255548 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.255733 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.256522 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.257369 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.257693 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.257767 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.257974 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.258114 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.258191 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.258247 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.258270 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 00:35:25.264678 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.261458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:57017 (local address 127.7.252.1:34777)
0807 00:35:25.261505 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.261508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.261559 (+ 51us) server_negotiation.cc:407] Connection header received
0807 00:35:25.261636 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.261637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.261647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.261696 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.261897 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.262497 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.263719 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.264007 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.264135 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.264337 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.264428 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.264490 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.264562 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.264585 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:35:25.264693 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.261333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.7.252.3:57017)
0807 00:35:25.261505 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.261516 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.261574 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.261707 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.261708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.261709 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:25.261780 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.261781 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.262575 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.262576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.263614 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.263617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.264134 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.264135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.264209 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.264235 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.264504 (+ 269us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.264507 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.264556 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.264600 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260807 00:35:25.268177 16408 raft_consensus.cc:1261] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Refusing update from remote peer 7f169c4216884ac7b1ffaa9adf9890d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.268242 16265 raft_consensus.cc:1261] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Refusing update from remote peer 7f169c4216884ac7b1ffaa9adf9890d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.268676 16655 consensus_queue.cc:1035] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.268875 16631 consensus_queue.cc:1035] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.279165 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.276082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:34909 (local address 127.7.252.3:39349)
0807 00:35:25.276129 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.276131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.276290 (+ 159us) server_negotiation.cc:407] Connection header received
0807 00:35:25.276462 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.276464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.276478 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.276541 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.276672 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.277244 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.278218 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.278503 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.278601 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.278864 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.278903 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.278984 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.279051 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.279074 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:25.279186 16681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.276001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:39349 (local address 127.7.252.1:34909)
0807 00:35:25.276224 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.276237 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.276312 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.276546 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.276547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.276549 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:25.276604 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.276606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.277350 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.277352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.278122 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.278125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.278605 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.278606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.278713 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.278735 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.278984 (+ 249us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.278987 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.279046 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.279101 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":97,"threads_started":1}
I20260807 00:35:25.290012 16102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:25.290158 16102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:25.290990 16102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Sending DeleteTablet for 3 replicas of tablet 6906df5219c44e659936faac9d295adb
I20260807 00:35:25.291296 16244 tablet_service.cc:1514] Processing DeleteTablet for tablet 6906df5219c44e659936faac9d295adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:33032
I20260807 00:35:25.291394 16649 tablet_replica.cc:330] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: stopping tablet replica
I20260807 00:35:25.291380 16388 tablet_service.cc:1514] Processing DeleteTablet for tablet 6906df5219c44e659936faac9d295adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:37558
I20260807 00:35:25.291447 16649 raft_consensus.cc:2229] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:25.291487 16649 raft_consensus.cc:2258] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.291575 16647 tablet_replica.cc:330] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: stopping tablet replica
I20260807 00:35:25.291615 16529 tablet_service.cc:1514] Processing DeleteTablet for tablet 6906df5219c44e659936faac9d295adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:32992
I20260807 00:35:25.291640 16647 raft_consensus.cc:2229] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:25.291687 16647 raft_consensus.cc:2258] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.291779 16648 tablet_replica.cc:330] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: stopping tablet replica
I20260807 00:35:25.291850 16648 raft_consensus.cc:2229] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:25.291951 16648 raft_consensus.cc:2258] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.292088 16647 ts_tablet_manager.cc:1905] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.292210 16649 ts_tablet_manager.cc:1905] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.294359 16648 ts_tablet_manager.cc:1905] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.296684 16648 ts_tablet_manager.cc:1918] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:25.296806 16648 log.cc:1196] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/6906df5219c44e659936faac9d295adb
I20260807 00:35:25.297056 16648 ts_tablet_manager.cc:1939] T 6906df5219c44e659936faac9d295adb P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting consensus metadata
I20260807 00:35:25.297442 16649 ts_tablet_manager.cc:1918] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:25.297513 16649 log.cc:1196] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/6906df5219c44e659936faac9d295adb
I20260807 00:35:25.297763 16649 ts_tablet_manager.cc:1939] T 6906df5219c44e659936faac9d295adb P aee2f700ad324545a12a3244505ca240: Deleting consensus metadata
I20260807 00:35:25.298197 16087 catalog_manager.cc:4841] TS aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777): tablet 6906df5219c44e659936faac9d295adb (table test-table [id=70aa141e568041d2962b4d07251262f2]) successfully deleted
I20260807 00:35:25.298540 16647 ts_tablet_manager.cc:1918] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:25.298614 16647 log.cc:1196] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/6906df5219c44e659936faac9d295adb
I20260807 00:35:25.298894 16647 ts_tablet_manager.cc:1939] T 6906df5219c44e659936faac9d295adb P c70b3591c394406dbec833ac27e449b6: Deleting consensus metadata
I20260807 00:35:25.299403 16090 catalog_manager.cc:4841] TS c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689): tablet 6906df5219c44e659936faac9d295adb (table test-table [id=70aa141e568041d2962b4d07251262f2]) successfully deleted
I20260807 00:35:25.299813 16090 catalog_manager.cc:4841] TS 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349): tablet 6906df5219c44e659936faac9d295adb (table test-table [id=70aa141e568041d2962b4d07251262f2]) successfully deleted
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
W20260807 00:35:25.338054 16663 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:25.328313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51572 (local address 127.7.252.62:44101)
0807 00:35:25.328383 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.328386 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.328614 (+ 228us) server_negotiation.cc:407] Connection header received
0807 00:35:25.328682 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.328684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.328706 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.328783 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:25.329630 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.330481 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.331861 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.332242 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.332320 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.337977 (+ 5657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51572: BlockingRecv error: recv got EOF from 127.0.0.1:51572 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM
I20260807 00:35:25.350824 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.339891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51580 (local address 127.7.252.62:44101)
0807 00:35:25.339936 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.339938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.340220 (+ 282us) server_negotiation.cc:407] Connection header received
0807 00:35:25.340285 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.340286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.340298 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.340369 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:25.341158 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.342050 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.343233 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.343572 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.343649 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.346903 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:25.346904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:25.346905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:25.346915 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:25.349066 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:25.349545 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:25.349546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:25.349547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:25.349624 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:25.349958 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:25.349959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:25.349960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:25.350130 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:25.350252 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.350499 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.350603 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:35:25.353552 16102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:25.353763 16102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:25.355623 16388 tablet_service.cc:1467] Processing CreateTablet for tablet 7b8fd694419645bb91e94cc1f2b7e44c (DEFAULT_TABLE table=test-table [id=90ff4de05e0844d2ace20e61723007c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:25.355717 16244 tablet_service.cc:1467] Processing CreateTablet for tablet 7b8fd694419645bb91e94cc1f2b7e44c (DEFAULT_TABLE table=test-table [id=90ff4de05e0844d2ace20e61723007c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:25.355792 16388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b8fd694419645bb91e94cc1f2b7e44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.355868 16244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b8fd694419645bb91e94cc1f2b7e44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.357402 16529 tablet_service.cc:1467] Processing CreateTablet for tablet 7b8fd694419645bb91e94cc1f2b7e44c (DEFAULT_TABLE table=test-table [id=90ff4de05e0844d2ace20e61723007c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:25.357465 16624 tablet_bootstrap.cc:492] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Bootstrap starting.
I20260807 00:35:25.357540 16529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b8fd694419645bb91e94cc1f2b7e44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.357887 16624 tablet_bootstrap.cc:654] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.358814 16626 tablet_bootstrap.cc:492] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Bootstrap starting.
I20260807 00:35:25.359251 16626 tablet_bootstrap.cc:654] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.359666 16625 tablet_bootstrap.cc:492] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Bootstrap starting.
I20260807 00:35:25.360098 16625 tablet_bootstrap.cc:654] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.360076 16626 tablet_bootstrap.cc:492] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: No bootstrap required, opened a new log
I20260807 00:35:25.360157 16626 ts_tablet_manager.cc:1397] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:25.360332 16626 raft_consensus.cc:348] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.360409 16626 raft_consensus.cc:374] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.360430 16626 raft_consensus.cc:729] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70b3591c394406dbec833ac27e449b6, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.360464 16626 consensus_queue.cc:260] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.360558 16626 ts_tablet_manager.cc:1428] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.361660 16625 tablet_bootstrap.cc:492] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: No bootstrap required, opened a new log
I20260807 00:35:25.361733 16625 ts_tablet_manager.cc:1397] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:35:25.361951 16625 raft_consensus.cc:348] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.362067 16625 raft_consensus.cc:374] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.362094 16625 raft_consensus.cc:729] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f169c4216884ac7b1ffaa9adf9890d3, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.362143 16625 consensus_queue.cc:260] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.362252 16625 ts_tablet_manager.cc:1428] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 00:35:25.363111 16624 tablet_bootstrap.cc:492] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: No bootstrap required, opened a new log
I20260807 00:35:25.363176 16624 ts_tablet_manager.cc:1397] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260807 00:35:25.363296 16624 raft_consensus.cc:348] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.363368 16624 raft_consensus.cc:374] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.363389 16624 raft_consensus.cc:729] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee2f700ad324545a12a3244505ca240, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.363437 16624 consensus_queue.cc:260] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.363536 16624 ts_tablet_manager.cc:1428] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.631963 16632 raft_consensus.cc:482] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:25.632093 16632 raft_consensus.cc:504] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.632527 16632 leader_election.cc:288] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:25.636863 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.632893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:35449 (local address 127.7.252.3:39349)
0807 00:35:25.632957 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.632960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.633055 (+ 95us) server_negotiation.cc:407] Connection header received
0807 00:35:25.633154 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.633155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.633165 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.633230 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:25.633400 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.633927 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.635974 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.636396 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.636454 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.636463 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.636729 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.636771 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 00:35:25.636890 16699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.632757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:39349 (local address 127.7.252.2:35449)
0807 00:35:25.632978 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.632998 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.633084 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.633248 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.633249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.633251 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:25.633322 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.633325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.634016 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.634017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.635859 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.635862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.636581 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.636582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.636650 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.636654 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.636710 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.636757 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":866,"thread_start_us":109,"threads_started":1}
I20260807 00:35:25.636994 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.632905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:42213 (local address 127.7.252.1:34777)
0807 00:35:25.633008 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.633010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.633100 (+ 90us) server_negotiation.cc:407] Connection header received
0807 00:35:25.633265 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.633266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.633281 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.633343 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:25.633544 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.634091 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.636074 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.636574 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.636648 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.636659 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.636865 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.636919 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 00:35:25.637142 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.632786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.7.252.2:42213)
0807 00:35:25.632986 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.632998 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.633087 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.633382 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.633383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.633385 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:25.633462 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.633464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.634267 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.634268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.635964 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.635967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.636674 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.636675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.636761 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.636772 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.636832 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.636879 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":88,"threads_started":1}
I20260807 00:35:25.637135 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b8fd694419645bb91e94cc1f2b7e44c" candidate_uuid: "c70b3591c394406dbec833ac27e449b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" is_pre_election: true
I20260807 00:35:25.637221 16549 raft_consensus.cc:2454] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70b3591c394406dbec833ac27e449b6 in term 0.
I20260807 00:35:25.637501 16265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b8fd694419645bb91e94cc1f2b7e44c" candidate_uuid: "c70b3591c394406dbec833ac27e449b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee2f700ad324545a12a3244505ca240" is_pre_election: true
I20260807 00:35:25.637493 16340 leader_election.cc:302] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, c70b3591c394406dbec833ac27e449b6; no voters:
I20260807 00:35:25.637593 16265 raft_consensus.cc:2454] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70b3591c394406dbec833ac27e449b6 in term 0.
I20260807 00:35:25.637643 16632 raft_consensus.cc:2781] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:25.637683 16632 raft_consensus.cc:482] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:25.637713 16632 raft_consensus.cc:3037] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.638464 16632 raft_consensus.cc:504] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.638623 16632 leader_election.cc:288] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [CANDIDATE]: Term 1 election: Requested vote from peers aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:25.638829 16265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b8fd694419645bb91e94cc1f2b7e44c" candidate_uuid: "c70b3591c394406dbec833ac27e449b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee2f700ad324545a12a3244505ca240"
I20260807 00:35:25.638924 16265 raft_consensus.cc:3037] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.639048 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b8fd694419645bb91e94cc1f2b7e44c" candidate_uuid: "c70b3591c394406dbec833ac27e449b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
I20260807 00:35:25.639138 16549 raft_consensus.cc:3037] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.639678 16265 raft_consensus.cc:2454] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70b3591c394406dbec833ac27e449b6 in term 1.
I20260807 00:35:25.639907 16337 leader_election.cc:302] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee2f700ad324545a12a3244505ca240, c70b3591c394406dbec833ac27e449b6; no voters:
I20260807 00:35:25.639915 16549 raft_consensus.cc:2454] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70b3591c394406dbec833ac27e449b6 in term 1.
I20260807 00:35:25.640003 16632 raft_consensus.cc:2781] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:25.640130 16632 raft_consensus.cc:686] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 1 LEADER]: Becoming Leader. State: Replica: c70b3591c394406dbec833ac27e449b6, State: Running, Role: LEADER
I20260807 00:35:25.640226 16632 consensus_queue.cc:237] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.641122 16102 catalog_manager.cc:5495] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70b3591c394406dbec833ac27e449b6 (127.7.252.2). New cstate: current_term: 1 leader_uuid: "c70b3591c394406dbec833ac27e449b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:25.650271 16704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.647475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.7.252.2:34689)
0807 00:35:25.647651 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.647653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.647663 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:25.647711 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.647712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.647731 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.647821 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.647966 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.648475 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.649439 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.649639 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.649696 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.649918 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.650029 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.650101 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.650134 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.650154 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":122,"threads_started":1}
I20260807 00:35:25.651508 16549 raft_consensus.cc:1261] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Refusing update from remote peer c70b3591c394406dbec833ac27e449b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.651556 16265 raft_consensus.cc:1261] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Refusing update from remote peer c70b3591c394406dbec833ac27e449b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.651849 16632 consensus_queue.cc:1035] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.652015 16701 consensus_queue.cc:1035] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.655416 16103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:25.655535 16103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:25.656354 16103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Sending DeleteTablet for 3 replicas of tablet 7b8fd694419645bb91e94cc1f2b7e44c
I20260807 00:35:25.656679 16244 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b8fd694419645bb91e94cc1f2b7e44c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:33032
I20260807 00:35:25.656693 16529 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b8fd694419645bb91e94cc1f2b7e44c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:32992
I20260807 00:35:25.656795 16648 tablet_replica.cc:330] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: stopping tablet replica
I20260807 00:35:25.656809 16649 tablet_replica.cc:330] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: stopping tablet replica
I20260807 00:35:25.656862 16648 raft_consensus.cc:2229] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:25.656869 16649 raft_consensus.cc:2229] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:25.656910 16648 raft_consensus.cc:2258] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.656917 16649 raft_consensus.cc:2258] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.657073 16388 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b8fd694419645bb91e94cc1f2b7e44c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:37558
I20260807 00:35:25.657186 16647 tablet_replica.cc:330] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: stopping tablet replica
I20260807 00:35:25.657243 16647 raft_consensus.cc:2229] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:25.657338 16647 raft_consensus.cc:2258] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.657411 16649 ts_tablet_manager.cc:1905] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.657680 16647 ts_tablet_manager.cc:1905] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.657624 16103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:25.657778 16103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:25.659250 16244 tablet_service.cc:1467] Processing CreateTablet for tablet ff0a0f950dda4d55a1eedd11afbb3ee5 (DEFAULT_TABLE table=test-table [id=a84e0f6dcbe4412790c7508f4a976953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:25.659379 16244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0a0f950dda4d55a1eedd11afbb3ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.659360 16529 tablet_service.cc:1467] Processing CreateTablet for tablet ff0a0f950dda4d55a1eedd11afbb3ee5 (DEFAULT_TABLE table=test-table [id=a84e0f6dcbe4412790c7508f4a976953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:25.659446 16647 ts_tablet_manager.cc:1918] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:25.659478 16529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0a0f950dda4d55a1eedd11afbb3ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.659507 16647 log.cc:1196] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/7b8fd694419645bb91e94cc1f2b7e44c
I20260807 00:35:25.659739 16647 ts_tablet_manager.cc:1939] T 7b8fd694419645bb91e94cc1f2b7e44c P c70b3591c394406dbec833ac27e449b6: Deleting consensus metadata
I20260807 00:35:25.659382 16649 ts_tablet_manager.cc:1918] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:25.660061 16649 log.cc:1196] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/7b8fd694419645bb91e94cc1f2b7e44c
I20260807 00:35:25.660264 16649 ts_tablet_manager.cc:1939] T 7b8fd694419645bb91e94cc1f2b7e44c P aee2f700ad324545a12a3244505ca240: Deleting consensus metadata
I20260807 00:35:25.660668 16624 tablet_bootstrap.cc:492] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240: Bootstrap starting.
I20260807 00:35:25.660879 16625 tablet_bootstrap.cc:492] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Bootstrap starting.
I20260807 00:35:25.660990 16624 tablet_bootstrap.cc:654] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.661057 16087 catalog_manager.cc:4841] TS aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777): tablet 7b8fd694419645bb91e94cc1f2b7e44c (table test-table [id=90ff4de05e0844d2ace20e61723007c5]) successfully deleted
I20260807 00:35:25.661260 16090 catalog_manager.cc:4841] TS c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689): tablet 7b8fd694419645bb91e94cc1f2b7e44c (table test-table [id=90ff4de05e0844d2ace20e61723007c5]) successfully deleted
I20260807 00:35:25.661273 16625 tablet_bootstrap.cc:654] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.661337 16388 tablet_service.cc:1467] Processing CreateTablet for tablet ff0a0f950dda4d55a1eedd11afbb3ee5 (DEFAULT_TABLE table=test-table [id=a84e0f6dcbe4412790c7508f4a976953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:25.661437 16388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0a0f950dda4d55a1eedd11afbb3ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:25.661909 16625 tablet_bootstrap.cc:492] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: No bootstrap required, opened a new log
I20260807 00:35:25.661958 16625 ts_tablet_manager.cc:1397] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:25.662066 16625 raft_consensus.cc:348] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.662150 16625 raft_consensus.cc:374] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.662173 16625 raft_consensus.cc:729] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f169c4216884ac7b1ffaa9adf9890d3, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.662223 16625 consensus_queue.cc:260] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.662350 16625 ts_tablet_manager.cc:1428] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.662822 16626 tablet_bootstrap.cc:492] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Bootstrap starting.
I20260807 00:35:25.663245 16626 tablet_bootstrap.cc:654] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:25.663403 16648 ts_tablet_manager.cc:1905] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.663662 16624 tablet_bootstrap.cc:492] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240: No bootstrap required, opened a new log
I20260807 00:35:25.663704 16624 ts_tablet_manager.cc:1397] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 00:35:25.663816 16624 raft_consensus.cc:348] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.663903 16624 raft_consensus.cc:374] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.663923 16624 raft_consensus.cc:729] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee2f700ad324545a12a3244505ca240, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.663967 16624 consensus_queue.cc:260] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.664067 16624 ts_tablet_manager.cc:1428] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.664995 16648 ts_tablet_manager.cc:1918] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:25.665035 16648 log.cc:1196] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/7b8fd694419645bb91e94cc1f2b7e44c
I20260807 00:35:25.665258 16648 ts_tablet_manager.cc:1939] T 7b8fd694419645bb91e94cc1f2b7e44c P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting consensus metadata
I20260807 00:35:25.665894 16626 tablet_bootstrap.cc:492] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: No bootstrap required, opened a new log
I20260807 00:35:25.665884 16090 catalog_manager.cc:4841] TS 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349): tablet 7b8fd694419645bb91e94cc1f2b7e44c (table test-table [id=90ff4de05e0844d2ace20e61723007c5]) successfully deleted
I20260807 00:35:25.665951 16626 ts_tablet_manager.cc:1397] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 00:35:25.666109 16626 raft_consensus.cc:348] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.666194 16626 raft_consensus.cc:374] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:25.666216 16626 raft_consensus.cc:729] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70b3591c394406dbec833ac27e449b6, State: Initialized, Role: FOLLOWER
I20260807 00:35:25.666257 16626 consensus_queue.cc:260] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.666340 16626 ts_tablet_manager.cc:1428] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:25.823701 16635 raft_consensus.cc:482] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:25.823833 16635 raft_consensus.cc:504] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.824047 16635 leader_election.cc:288] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:25.824307 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0a0f950dda4d55a1eedd11afbb3ee5" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6" is_pre_election: true
I20260807 00:35:25.824347 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0a0f950dda4d55a1eedd11afbb3ee5" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" is_pre_election: true
I20260807 00:35:25.824429 16549 raft_consensus.cc:2454] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 0.
I20260807 00:35:25.824445 16408 raft_consensus.cc:2454] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 0.
I20260807 00:35:25.824643 16198 leader_election.cc:302] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee2f700ad324545a12a3244505ca240, c70b3591c394406dbec833ac27e449b6; no voters:
I20260807 00:35:25.824815 16635 raft_consensus.cc:2781] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:25.824868 16635 raft_consensus.cc:482] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:25.824883 16635 raft_consensus.cc:3037] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.825608 16635 raft_consensus.cc:504] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.825706 16635 leader_election.cc:288] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 election: Requested vote from peers c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689), 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349)
I20260807 00:35:25.825934 16549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0a0f950dda4d55a1eedd11afbb3ee5" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f169c4216884ac7b1ffaa9adf9890d3"
I20260807 00:35:25.826002 16549 raft_consensus.cc:3037] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.825937 16408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0a0f950dda4d55a1eedd11afbb3ee5" candidate_uuid: "aee2f700ad324545a12a3244505ca240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70b3591c394406dbec833ac27e449b6"
I20260807 00:35:25.826036 16408 raft_consensus.cc:3037] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:25.826709 16549 raft_consensus.cc:2454] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 1.
I20260807 00:35:25.826867 16408 raft_consensus.cc:2454] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee2f700ad324545a12a3244505ca240 in term 1.
I20260807 00:35:25.826891 16198 leader_election.cc:302] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f169c4216884ac7b1ffaa9adf9890d3, aee2f700ad324545a12a3244505ca240; no voters:
I20260807 00:35:25.827067 16635 raft_consensus.cc:2781] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:25.827221 16635 raft_consensus.cc:686] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [term 1 LEADER]: Becoming Leader. State: Replica: aee2f700ad324545a12a3244505ca240, State: Running, Role: LEADER
I20260807 00:35:25.827346 16635 consensus_queue.cc:237] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } }
I20260807 00:35:25.828020 16102 catalog_manager.cc:5495] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee2f700ad324545a12a3244505ca240 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "aee2f700ad324545a12a3244505ca240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee2f700ad324545a12a3244505ca240" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 34777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:25.853755 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.851437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33074 (local address 127.7.252.1:34777)
0807 00:35:25.851511 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.851513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.851521 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:25.851550 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.851551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.851560 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.851626 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.851799 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.852286 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.853021 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.853223 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.853303 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.853448 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.853492 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.853573 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.853628 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.853651 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:35:25.858815 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.856625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:56383 (local address 127.7.252.1:34777)
0807 00:35:25.856664 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:25.856666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:25.856680 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:35:25.856699 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:25.856699 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:25.856707 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:25.856759 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:25.856918 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.857383 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.858154 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.858328 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.858377 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.858533 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.858558 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.858596 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:25.858647 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 00:35:25.858718 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:35:25.858829 16718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.856443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.7.252.1:56383)
0807 00:35:25.856597 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.856607 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:25.856651 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:25.856796 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:25.856798 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:25.856799 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 00:35:25.856841 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.856843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.857472 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.857473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.858078 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:25.858080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:25.858415 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:25.858416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:25.858464 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:25.858469 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 00:35:25.858610 (+ 141us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 00:35:25.858612 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 00:35:25.858646 (+ 34us) client_negotiation.cc:240] Negotiation successful
0807 00:35:25.858750 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":96,"threads_started":1}
I20260807 00:35:25.861400 16408 raft_consensus.cc:1261] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Refusing update from remote peer aee2f700ad324545a12a3244505ca240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.861425 16549 raft_consensus.cc:1261] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Refusing update from remote peer aee2f700ad324545a12a3244505ca240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:25.861641 16713 consensus_queue.cc:1035] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70b3591c394406dbec833ac27e449b6" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.861764 16715 consensus_queue.cc:1035] T ff0a0f950dda4d55a1eedd11afbb3ee5 P aee2f700ad324545a12a3244505ca240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f169c4216884ac7b1ffaa9adf9890d3" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:25.872287 16103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:25.872396 16103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:25.872987 16103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61cb1c0852884f908a084156089712e5: Sending DeleteTablet for 3 replicas of tablet ff0a0f950dda4d55a1eedd11afbb3ee5
I20260807 00:35:25.873263 16388 tablet_service.cc:1514] Processing DeleteTablet for tablet ff0a0f950dda4d55a1eedd11afbb3ee5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:37558
I20260807 00:35:25.873369 16529 tablet_service.cc:1514] Processing DeleteTablet for tablet ff0a0f950dda4d55a1eedd11afbb3ee5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:25 UTC) from {username='oryx', principal='oryx/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:32992
I20260807 00:35:25.873402 16647 tablet_replica.cc:330] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: stopping tablet replica
I20260807 00:35:25.873459 16647 raft_consensus.cc:2229] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:25.873500 16647 raft_consensus.cc:2258] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.873528 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16179
I20260807 00:35:25.873595 16648 tablet_replica.cc:330] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: stopping tablet replica
I20260807 00:35:25.873662 16648 raft_consensus.cc:2229] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:25.873695 16648 raft_consensus.cc:2258] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:25.875440 16648 ts_tablet_manager.cc:1905] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.876089 16647 ts_tablet_manager.cc:1905] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:25.877023 16648 ts_tablet_manager.cc:1918] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:25.877079 16648 log.cc:1196] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/ff0a0f950dda4d55a1eedd11afbb3ee5
I20260807 00:35:25.877318 16648 ts_tablet_manager.cc:1939] T ff0a0f950dda4d55a1eedd11afbb3ee5 P 7f169c4216884ac7b1ffaa9adf9890d3: Deleting consensus metadata
I20260807 00:35:25.877676 16090 catalog_manager.cc:4841] TS 7f169c4216884ac7b1ffaa9adf9890d3 (127.7.252.3:39349): tablet ff0a0f950dda4d55a1eedd11afbb3ee5 (table test-table [id=a84e0f6dcbe4412790c7508f4a976953]) successfully deleted
I20260807 00:35:25.877892 16647 ts_tablet_manager.cc:1918] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 00:35:25.877959 16647 log.cc:1196] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/ff0a0f950dda4d55a1eedd11afbb3ee5
I20260807 00:35:25.878163 16647 ts_tablet_manager.cc:1939] T ff0a0f950dda4d55a1eedd11afbb3ee5 P c70b3591c394406dbec833ac27e449b6: Deleting consensus metadata
I20260807 00:35:25.878639 16090 catalog_manager.cc:4841] TS c70b3591c394406dbec833ac27e449b6 (127.7.252.2:34689): tablet ff0a0f950dda4d55a1eedd11afbb3ee5 (table test-table [id=a84e0f6dcbe4412790c7508f4a976953]) successfully deleted
W20260807 00:35:25.881718 16087 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:34777 (error 108)
I20260807 00:35:25.882090 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16321
I20260807 00:35:25.882262 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:25.882068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:34777 (local address 127.0.0.1:33080)
0807 00:35:25.882161 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:25.882210 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:34777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":55,"threads_started":1}
W20260807 00:35:25.883574 16087 catalog_manager.cc:4584] TS aee2f700ad324545a12a3244505ca240 (127.7.252.1:34777): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff0a0f950dda4d55a1eedd11afbb3ee5: Network error: Client connection negotiation failed: client connection to 127.7.252.1:34777: connect: Connection refused (error 111)
I20260807 00:35:25.891044 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16464
I20260807 00:35:25.898172 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16071
2026-08-07T00:35:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3374 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16726](info): set up 2 sockets
Aug 07 00:35:25 dist-test-slave-csg5 krb5kdc[16726](info): commencing operation
krb5kdc: starting...
W20260807 00:35:27.012953 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:27 dist-test-slave-csg5 krb5kdc[16726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:27.154729 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:34611
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:39003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:34611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:27.240399 16739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:27.240625 16739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:27.240651 16739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:27.241926 16739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:27.241986 16739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:27.242002 16739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:27.242015 16739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:27.242034 16739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:27.243810 16739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:39003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:34611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:34611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:27.244088 16739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:27.244374 16739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:27.250427 16744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:27.250427 16748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:27.250442 16746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:27.250736 16739 server_base.cc:1034] running on GCE node
I20260807 00:35:27.251122 16739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:27.251462 16739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:27.252681 16739 hybrid_clock.cc:648] HybridClock initialized: now 1786062927252651 us; error 38 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T00:35:27Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1361 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:27 dist-test-slave-csg5 krb5kdc[16753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:27 dist-test-slave-csg5 krb5kdc[16753](info): set up 2 sockets
Aug 07 00:35:27 dist-test-slave-csg5 krb5kdc[16753](info): commencing operation
krb5kdc: starting...
W20260807 00:35:28.417312 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:28 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:28.554000 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36937
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:36937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:28.640333 16766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:28.640588 16766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:28.640631 16766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:28.641836 16766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:28.641911 16766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:28.641937 16766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:28.641958 16766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:28.641986 16766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:28.643592 16766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:36937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:28.643900 16766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:28.644155 16766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:28.649663 16774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:28.649688 16771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:28.649663 16772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:28.650053 16766 server_base.cc:1034] running on GCE node
I20260807 00:35:28.650353 16766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:28.650727 16766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:28.651921 16766 hybrid_clock.cc:648] HybridClock initialized: now 1786062928651904 us; error 38 us; skew 500 ppm
Aug 07 00:35:28 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062928, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:28.654599 16766 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:28.655128 16766 webserver.cc:460] Webserver started at http://127.7.252.62:43099/ using document root <none> and password file <none>
I20260807 00:35:28.655406 16766 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:28.655480 16766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:28.655637 16766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:28.656821 16766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "6cc8add41b22454e97954352e23374be"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "df7093eea61733250850bd9b858fb989"
server_key_iv: "59046f74440face157b24b9aedc1bd34"
server_key_version: "encryptionkey@0"
I20260807 00:35:28.657192 16766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "6cc8add41b22454e97954352e23374be"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "df7093eea61733250850bd9b858fb989"
server_key_iv: "59046f74440face157b24b9aedc1bd34"
server_key_version: "encryptionkey@0"
I20260807 00:35:28.658613 16766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:28.659631 16781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:28.659955 16766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:28.660075 16766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "6cc8add41b22454e97954352e23374be"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "df7093eea61733250850bd9b858fb989"
server_key_iv: "59046f74440face157b24b9aedc1bd34"
server_key_version: "encryptionkey@0"
I20260807 00:35:28.660157 16766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:28.693025 16766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:28.695670 16766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:28.695886 16766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:28.700260 16766 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:36937
I20260807 00:35:28.700301 16834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:36937 every 8 connection(s)
I20260807 00:35:28.700692 16766 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:28.701599 16835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:28.704233 16835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Bootstrap starting.
I20260807 00:35:28.704903 16835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:28.705253 16835 log.cc:824] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:28.706040 16835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: No bootstrap required, opened a new log
I20260807 00:35:28.707854 16835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:28.708016 16835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:28.708039 16835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc8add41b22454e97954352e23374be, State: Initialized, Role: FOLLOWER
I20260807 00:35:28.708207 16835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:28.708297 16835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:28.708333 16835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:28.708374 16835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:28.708964 16835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:28.709086 16835 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc8add41b22454e97954352e23374be; no voters:
I20260807 00:35:28.709331 16835 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:28.709519 16838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:28.709669 16835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:28.709988 16838 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 LEADER]: Becoming Leader. State: Replica: 6cc8add41b22454e97954352e23374be, State: Running, Role: LEADER
I20260807 00:35:28.710090 16838 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:28.710421 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16766
I20260807 00:35:28.710551 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:28.710566 16840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc8add41b22454e97954352e23374be. Latest consensus state: current_term: 1 leader_uuid: "6cc8add41b22454e97954352e23374be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } } }
I20260807 00:35:28.710641 16840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:28.710778 8176 external_mini_cluster.cc:1428] Setting key f55ab9c48c3d190f227a97b1afa593a3
I20260807 00:35:28.711211 16839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cc8add41b22454e97954352e23374be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } } }
I20260807 00:35:28.711203 16847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:28.711613 16839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:28.712184 16847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:28.714069 16847 catalog_manager.cc:1347] Generated new cluster ID: 7bc500a533b342fc97b83f39872e0f88
I20260807 00:35:28.714131 16847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:35:28 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:28.721698 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:28.711523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58358 (local address 127.7.252.62:36937)
0807 00:35:28.711733 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:28.711745 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:28.711781 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:35:28.711897 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:28.711903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:28.711979 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:28.712140 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:28.712986 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:28.714192 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:28.715069 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:28.715525 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:28.715661 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:28.718137 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:28.718142 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:28.718143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:28.718165 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:28.719964 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:28.720383 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:28.720387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:28.720387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:28.720486 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:28.720701 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:28.720702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:28.720703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:28.720985 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:28.721167 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:28.721246 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 00:35:28.721509 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":66,"threads_started":1}
I20260807 00:35:28.725001 16847 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:28.725596 16847 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:28.736003 16847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Generated new TSK 0
I20260807 00:35:28.736320 16847 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:28.770916 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36937
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:28.894353 16861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:28.894606 16861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:28.894636 16861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:28.896061 16861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:28.896123 16861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:28.896154 16861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:28.897960 16861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:28.898262 16861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:28.898633 16861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:28.904412 16861 server_base.cc:1034] running on GCE node
W20260807 00:35:28.904223 16867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:28.904546 16866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:28.904228 16869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:28.904798 16861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:28.905110 16861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:28.906318 16861 hybrid_clock.cc:648] HybridClock initialized: now 1786062928906296 us; error 46 us; skew 500 ppm
Aug 07 00:35:28 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062928, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:28.914554 16861 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:28.915086 16861 webserver.cc:460] Webserver started at http://127.7.252.1:41005/ using document root <none> and password file <none>
I20260807 00:35:28.915374 16861 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:28.915431 16861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:28.915576 16861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:28.916883 16861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "455b14db114c4d709342cf50e9ee1d4b"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "60145b1bf1758020950a23c218262f18"
server_key_iv: "8c4486c8afd81be568bf588beafd8b5e"
server_key_version: "encryptionkey@0"
I20260807 00:35:28.917304 16861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "455b14db114c4d709342cf50e9ee1d4b"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "60145b1bf1758020950a23c218262f18"
server_key_iv: "8c4486c8afd81be568bf588beafd8b5e"
server_key_version: "encryptionkey@0"
I20260807 00:35:28.919461 16861 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260807 00:35:28.920364 16876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:28.920578 16861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:28.920677 16861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "455b14db114c4d709342cf50e9ee1d4b"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "60145b1bf1758020950a23c218262f18"
server_key_iv: "8c4486c8afd81be568bf588beafd8b5e"
server_key_version: "encryptionkey@0"
I20260807 00:35:28.920751 16861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:28.947134 16861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:28.949548 16861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:28.949708 16861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:28.949981 16861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:28.950325 16861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:28.950381 16861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:28.950425 16861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:28.950453 16861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:28.956982 16861 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:38365
I20260807 00:35:28.957051 16990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:38365 every 8 connection(s)
I20260807 00:35:28.957392 16861 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:28.958621 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16861
I20260807 00:35:28.958767 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:28.958971 8176 external_mini_cluster.cc:1428] Setting key 4a3e7131db5faa0abf2009e8320c0532
Aug 07 00:35:28 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062928, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:35:28.968791 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:28.958204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:47635 (local address 127.7.252.62:36937)
0807 00:35:28.958255 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:28.958257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:28.958502 (+ 245us) server_negotiation.cc:407] Connection header received
0807 00:35:28.959279 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:28.959280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:28.959301 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:28.959357 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:28.960404 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:28.960904 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:28.961951 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:28.962205 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:28.962300 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:28.965159 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:28.965161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:28.965162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:28.965182 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:28.967018 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:28.967545 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:28.967546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:28.967547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:28.967622 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:28.967930 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:28.967931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:28.967932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:28.968086 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:28.968178 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:28.968559 (+ 381us) server_negotiation.cc:299] Negotiation successful
0807 00:35:28.968675 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:35:28.969009 16993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:28.958152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:47635)
0807 00:35:28.958335 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:28.958389 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:28.959160 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:28.959451 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:28.959456 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:28.960072 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:28.960279 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:28.960284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:28.961014 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:28.961015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:28.961850 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:28.961852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:28.962305 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:28.962306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:28.962464 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:28.963076 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:28.963085 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:28.965032 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:28.967134 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:28.967144 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:28.967147 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:28.967453 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:28.967715 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:28.967716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:28.967716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:28.967852 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:28.968167 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:28.968176 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:28.968403 (+ 227us) client_negotiation.cc:769] Sending connection context
0807 00:35:28.968532 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 00:35:28.968728 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260807 00:35:28.969693 16991 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36937
I20260807 00:35:28.969807 16991 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:28.970059 16991 heartbeater.cc:511] Master 127.7.252.62:36937 requested a full tablet report, sending...
I20260807 00:35:28.970849 16798 ts_manager.cc:194] Registered new tserver with Master: 455b14db114c4d709342cf50e9ee1d4b (127.7.252.1:38365)
I20260807 00:35:28.971516 16798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:47635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:28.989996 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36937
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:29.076841 16996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:29.077103 16996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:29.077142 16996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:29.078357 16996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:29.078428 16996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:29.078474 16996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:29.079967 16996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:29.080348 16996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:29.080613 16996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:29.086200 17002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.086272 17004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.086467 17001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.086449 16996 server_base.cc:1034] running on GCE node
I20260807 00:35:29.086836 16996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:29.087086 16996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:29.088284 16996 hybrid_clock.cc:648] HybridClock initialized: now 1786062929088242 us; error 59 us; skew 500 ppm
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:29.091614 16996 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:29.092208 16996 webserver.cc:460] Webserver started at http://127.7.252.2:34963/ using document root <none> and password file <none>
I20260807 00:35:29.092478 16996 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:29.092531 16996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:29.092731 16996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:29.093931 16996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "5ba197a63d3e467099d5042c0f579558"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "efa0e5f92decb0092337a98a9c9074f4"
server_key_iv: "d119920124caf53e4ecb4463f2758596"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.094344 16996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "5ba197a63d3e467099d5042c0f579558"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "efa0e5f92decb0092337a98a9c9074f4"
server_key_iv: "d119920124caf53e4ecb4463f2758596"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.096051 16996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260807 00:35:29.096922 17011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.097164 16996 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:29.097254 16996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "5ba197a63d3e467099d5042c0f579558"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "efa0e5f92decb0092337a98a9c9074f4"
server_key_iv: "d119920124caf53e4ecb4463f2758596"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.097360 16996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:29.120322 16996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:29.122802 16996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:29.122977 16996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:29.123245 16996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:29.123584 16996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:29.123651 16996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.123713 16996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:29.123735 16996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.129914 16996 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:38503
I20260807 00:35:29.129977 17125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:38503 every 8 connection(s)
I20260807 00:35:29.130347 16996 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:29.136436 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 16996
I20260807 00:35:29.136538 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:29.136826 8176 external_mini_cluster.cc:1428] Setting key c58acfd307c69a23091d83a0b6ba5ede
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:29.141417 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.131442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:50929 (local address 127.7.252.62:36937)
0807 00:35:29.131507 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.131509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.131523 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:35:29.132061 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.132062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.132076 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.132133 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.133236 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.133801 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.134858 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.135056 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.135145 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.137844 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:29.137845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:29.137846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:29.137855 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:29.139683 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:29.140262 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:29.140263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:29.140263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:29.140327 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:29.140637 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:29.140637 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:29.140638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:29.140751 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:29.140824 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:29.141195 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 00:35:29.141303 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 00:35:29.141458 17128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.131169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:50929)
0807 00:35:29.131354 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.131400 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.131946 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.132215 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.132311 (+ 96us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.132917 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.133128 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.133132 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.133909 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.133910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.134758 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.134760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.135156 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.135158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.135295 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.135841 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.135850 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.137723 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:29.139796 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:29.139809 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:29.139812 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:29.140175 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:29.140407 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:29.140408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:29.140409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:29.140562 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:29.140843 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:29.140849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:29.141021 (+ 172us) client_negotiation.cc:769] Sending connection context
0807 00:35:29.141148 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 00:35:29.141284 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260807 00:35:29.142032 17126 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36937
I20260807 00:35:29.142146 17126 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:29.142409 17126 heartbeater.cc:511] Master 127.7.252.62:36937 requested a full tablet report, sending...
I20260807 00:35:29.142926 16798 ts_manager.cc:194] Registered new tserver with Master: 5ba197a63d3e467099d5042c0f579558 (127.7.252.2:38503)
I20260807 00:35:29.143477 16798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:50929
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:29.167389 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36937
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:29.255398 17131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:29.255631 17131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:29.255658 17131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:29.256894 17131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:29.256937 17131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:29.256964 17131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:29.258423 17131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:29.258638 17131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:29.258944 17131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:29.264511 17139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.264573 17137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.264568 17136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.264911 17131 server_base.cc:1034] running on GCE node
I20260807 00:35:29.265131 17131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:29.265403 17131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:29.266595 17131 hybrid_clock.cc:648] HybridClock initialized: now 1786062929266595 us; error 45 us; skew 500 ppm
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:29.269392 17131 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:29.269894 17131 webserver.cc:460] Webserver started at http://127.7.252.3:36959/ using document root <none> and password file <none>
I20260807 00:35:29.270188 17131 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:29.270287 17131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:29.270505 17131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:29.271822 17131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "cf0b85d13f744a10afb8931702e94083"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "c380308888c4e2ec6a272f70cb8591ff"
server_key_iv: "5edc470476bb7521f3b9dc0f2863920c"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.272274 17131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "cf0b85d13f744a10afb8931702e94083"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "c380308888c4e2ec6a272f70cb8591ff"
server_key_iv: "5edc470476bb7521f3b9dc0f2863920c"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.274147 17131 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 00:35:29.275084 17147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.275352 17131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:29.275475 17131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "cf0b85d13f744a10afb8931702e94083"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "c380308888c4e2ec6a272f70cb8591ff"
server_key_iv: "5edc470476bb7521f3b9dc0f2863920c"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.275556 17131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:29.285754 17131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:29.288319 17131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:29.288503 17131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:29.288775 17131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:29.289119 17131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:29.289176 17131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.289217 17131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:29.289247 17131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.295667 17131 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:45729
I20260807 00:35:29.295715 17261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:45729 every 8 connection(s)
I20260807 00:35:29.296051 17131 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:29.303877 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17131
I20260807 00:35:29.303994 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:29.304194 8176 external_mini_cluster.cc:1428] Setting key e9aa1aa2a2eec8c6400d055ae1afbbd5
I20260807 00:35:29.306519 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.296872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:53353 (local address 127.7.252.62:36937)
0807 00:35:29.296924 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.296930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.297104 (+ 174us) server_negotiation.cc:407] Connection header received
0807 00:35:29.297633 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.297635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.297647 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.297716 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.298762 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.299267 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.300366 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.300638 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.300724 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.303286 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:29.303288 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:29.303288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:29.303298 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:29.305100 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:29.305571 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:29.305572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:29.305572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:29.305630 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:29.305904 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:29.305904 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:29.305905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:29.306029 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:29.306087 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:29.306372 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 00:35:29.306451 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:35:29.306697 17264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.296805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:53353)
0807 00:35:29.296972 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.297014 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.297501 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.297812 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.297815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.298401 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.298614 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.298619 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.299369 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.299370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.300190 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.300193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.300736 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.300736 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.300871 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.301537 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.301546 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.303160 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:29.305201 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:29.305211 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:29.305214 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:29.305481 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:29.305701 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:29.305702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:29.305702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:29.305836 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:29.306089 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:29.306093 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:29.306221 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 00:35:29.306311 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 00:35:29.306442 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260807 00:35:29.307487 17262 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36937
I20260807 00:35:29.307593 17262 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:29.307814 17262 heartbeater.cc:511] Master 127.7.252.62:36937 requested a full tablet report, sending...
I20260807 00:35:29.308389 16798 ts_manager.cc:194] Registered new tserver with Master: cf0b85d13f744a10afb8931702e94083 (127.7.252.3:45729)
I20260807 00:35:29.308832 16798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:53353
I20260807 00:35:29.316238 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab.
Entry for principal oryx/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab.
WARNING: no policy specified for oryx/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab.
Entry for principal oryx/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab.
WARNING: no policy specified for oryx/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab.
Entry for principal oryx/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab.
I20260807 00:35:29.402786 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16861
I20260807 00:35:29.409227 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16996
I20260807 00:35:29.415115 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17131
I20260807 00:35:29.420647 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 16766
I20260807 00:35:29.427723 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36937
--webserver_interface=127.7.252.62
--webserver_port=43099
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:36937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:29.513969 17271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:29.514240 17271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:29.514281 17271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:29.515564 17271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:29.515642 17271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:29.515667 17271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:29.515689 17271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:29.515717 17271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:29.517302 17271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:36937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=43099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:29.517597 17271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:29.517843 17271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:29.522974 17277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.523002 17276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.522971 17279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.523384 17271 server_base.cc:1034] running on GCE node
I20260807 00:35:29.523684 17271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:29.523957 17271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:29.525117 17271 hybrid_clock.cc:648] HybridClock initialized: now 1786062929525101 us; error 28 us; skew 500 ppm
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:29.528244 17271 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:29.528898 17271 webserver.cc:460] Webserver started at http://127.7.252.62:43099/ using document root <none> and password file <none>
I20260807 00:35:29.529153 17271 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:29.529251 17271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:29.530921 17271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:35:29.531800 17286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.532042 17271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:29.532164 17271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "6cc8add41b22454e97954352e23374be"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "df7093eea61733250850bd9b858fb989"
server_key_iv: "59046f74440face157b24b9aedc1bd34"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.532552 17271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:29.553529 17271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:29.556141 17271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:29.556280 17271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:29.560631 17271 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:36937
I20260807 00:35:29.560701 17339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:36937 every 8 connection(s)
I20260807 00:35:29.561100 17271 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:29.562736 17341 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:35:29.563458 17341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Bootstrap starting.
I20260807 00:35:29.563817 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17271
I20260807 00:35:29.564127 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:38365
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:36937
--webserver_port=41005
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:35:29.575529 17341 log.cc:824] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:29.578122 17341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:35:29.578477 17341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Bootstrap complete.
I20260807 00:35:29.581961 17341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:29.582312 17341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc8add41b22454e97954352e23374be, State: Initialized, Role: FOLLOWER
I20260807 00:35:29.582481 17341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:29.582551 17341 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:29.582597 17341 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:29.582636 17341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 1 FOLLOWER]: Advancing to term 2
I20260807 00:35:29.584084 17341 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:29.584216 17341 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc8add41b22454e97954352e23374be; no voters:
I20260807 00:35:29.584398 17341 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 00:35:29.584482 17345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 2 FOLLOWER]: Leader election won for term 2
I20260807 00:35:29.584657 17341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:29.584662 17345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [term 2 LEADER]: Becoming Leader. State: Replica: 6cc8add41b22454e97954352e23374be, State: Running, Role: LEADER
I20260807 00:35:29.584903 17345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } }
I20260807 00:35:29.585279 17346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6cc8add41b22454e97954352e23374be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } } }
I20260807 00:35:29.585278 17345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc8add41b22454e97954352e23374be. Latest consensus state: current_term: 2 leader_uuid: "6cc8add41b22454e97954352e23374be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8add41b22454e97954352e23374be" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36937 } } }
I20260807 00:35:29.585559 17345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:29.585551 17346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:29.586169 17355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:29.586781 17355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:29.586925 17355 catalog_manager.cc:1259] Loaded cluster ID: 7bc500a533b342fc97b83f39872e0f88
I20260807 00:35:29.586962 17355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:29.588119 17355 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:29.588302 17355 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6cc8add41b22454e97954352e23374be: Loaded TSK: 0
I20260807 00:35:29.588522 17355 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 00:35:29.657780 17343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:29.658038 17343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:29.658077 17343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:29.659394 17343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:29.659462 17343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:29.659510 17343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:29.661129 17343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.1.keytab
--principal=oryx/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:38365
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=41005
--tserver_master_addrs=127.7.252.62:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:29.661417 17343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:29.661674 17343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:29.668200 17369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.668381 17343 server_base.cc:1034] running on GCE node
W20260807 00:35:29.668459 17371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.668210 17368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.668759 17343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:29.669075 17343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:29.670274 17343 hybrid_clock.cc:648] HybridClock initialized: now 1786062929670253 us; error 42 us; skew 500 ppm
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:29.673981 17343 init.cc:377] Logged in from keytab as oryx/127.7.252.1@KRBTEST.COM (short username oryx)
I20260807 00:35:29.674708 17343 webserver.cc:460] Webserver started at http://127.7.252.1:41005/ using document root <none> and password file <none>
I20260807 00:35:29.674986 17343 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:29.675055 17343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:29.676681 17343 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:29.677438 17378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.677628 17343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:29.677711 17343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "455b14db114c4d709342cf50e9ee1d4b"
format_stamp: "Formatted at 2026-08-07 00:35:28 on dist-test-slave-csg5"
server_key: "60145b1bf1758020950a23c218262f18"
server_key_iv: "8c4486c8afd81be568bf588beafd8b5e"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.678174 17343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:29.714200 17343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:29.717353 17343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:29.717543 17343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:29.717854 17343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:29.718237 17343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:29.718284 17343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.718330 17343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:29.718351 17343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.726804 17343 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:38365
I20260807 00:35:29.726854 17495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:38365 every 8 connection(s)
I20260807 00:35:29.727380 17343 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:29.732227 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17343
I20260807 00:35:29.732573 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:38503
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:36937
--webserver_port=34963
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:29.739127 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.728475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:59253)
0807 00:35:29.728650 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.728695 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.729697 (+ 1002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.730331 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.730336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.730773 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.731071 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.731078 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.732645 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.732646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.733987 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.733991 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.734788 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.734790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.734941 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.735629 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.735640 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.738941 (+ 3301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
W20260807 00:35:29.739374 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:29.728539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:59253 (local address 127.7.252.62:36937)
0807 00:35:29.729907 (+ 1368us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.729915 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.729944 (+ 29us) server_negotiation.cc:407] Connection header received
0807 00:35:29.730048 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.730053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.730096 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.730215 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.731299 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.732507 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.734084 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.734622 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.734817 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.739150 (+ 4333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:59253: BlockingRecv error: recv got EOF from 127.7.252.1:59253 (error 108)
Metrics: {"server-negotiator.queue_time_us":1308,"thread_start_us":90,"threads_started":1}
W20260807 00:35:29.739691 17496 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:36937 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.252.62:36937: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:29.744904 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.740004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:44245)
0807 00:35:29.740044 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.740057 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.740127 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.740271 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.740272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.740439 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.740495 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.740497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.741273 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.741274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.741866 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.741868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.742297 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.742298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.742393 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.742963 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.742968 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.744814 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":18}
W20260807 00:35:29.745036 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:29.740064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:44245 (local address 127.7.252.62:36937)
0807 00:35:29.740126 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.740129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.740140 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:29.740197 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.740198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.740212 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.740269 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.740594 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.741176 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.741963 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.742208 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.742300 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.744958 (+ 2658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:44245: BlockingRecv error: recv got EOF from 127.7.252.1:44245 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:29.750926 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.745393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:44605)
0807 00:35:29.745508 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.745520 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.745579 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.745713 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.745714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.745864 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.745904 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.745906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.746566 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.746567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.747416 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.747418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.747786 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.747786 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.747863 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.748288 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.748294 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.750841 (+ 2547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94}
W20260807 00:35:29.751075 17496 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 00:35:29.751192 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:29.745459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:44605 (local address 127.7.252.62:36937)
0807 00:35:29.745518 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.745520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.745579 (+ 59us) server_negotiation.cc:407] Connection header received
0807 00:35:29.745637 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.745638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.745647 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.745694 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.745978 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.746487 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.747505 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.747697 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.747769 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.750941 (+ 3172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:44605: BlockingRecv error: recv got EOF from 127.7.252.1:44605 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 00:35:29.824383 17500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:29.824609 17500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:29.824635 17500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:29.825886 17500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:29.825933 17500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:29.825961 17500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:29.827519 17500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.2.keytab
--principal=oryx/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:38503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=34963
--tserver_master_addrs=127.7.252.62:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:29.827787 17500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:29.828037 17500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:29.833292 17508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.833365 17505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.833376 17506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.833663 17500 server_base.cc:1034] running on GCE node
I20260807 00:35:29.833938 17500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:29.834321 17500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:29.835587 17500 hybrid_clock.cc:648] HybridClock initialized: now 1786062929835522 us; error 85 us; skew 500 ppm
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:29.838483 17500 init.cc:377] Logged in from keytab as oryx/127.7.252.2@KRBTEST.COM (short username oryx)
I20260807 00:35:29.839071 17500 webserver.cc:460] Webserver started at http://127.7.252.2:34963/ using document root <none> and password file <none>
I20260807 00:35:29.839332 17500 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:29.839427 17500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:29.841012 17500 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:35:29.841988 17515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.842355 17500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:35:29.842588 17500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "5ba197a63d3e467099d5042c0f579558"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "efa0e5f92decb0092337a98a9c9074f4"
server_key_iv: "d119920124caf53e4ecb4463f2758596"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.843091 17500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:29.865059 17500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:29.867847 17500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:29.868093 17500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:29.868392 17500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:29.868763 17500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:29.868825 17500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.868865 17500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:29.868920 17500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.875711 17500 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:38503
I20260807 00:35:29.875759 17631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:38503 every 8 connection(s)
I20260807 00:35:29.876160 17500 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:29.880290 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17500
I20260807 00:35:29.880618 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:45729
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:36937
--webserver_port=36959
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
W20260807 00:35:29.885509 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:29.876988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:40979 (local address 127.7.252.62:36937)
0807 00:35:29.877053 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.877055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.877365 (+ 310us) server_negotiation.cc:407] Connection header received
0807 00:35:29.877921 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.877923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.877941 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.877992 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.879064 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.879574 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.880975 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.881239 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.881314 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.885386 (+ 4072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:40979: BlockingRecv error: recv got EOF from 127.7.252.2:40979 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 00:35:29.885509 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.876974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:40979)
0807 00:35:29.877183 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.877223 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.877808 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.878083 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.878087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.878712 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.878953 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.878958 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.879695 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.879696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.880879 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.880882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.881343 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.881344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.881498 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.882133 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.882144 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.885220 (+ 3076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":107,"threads_started":1}
W20260807 00:35:29.885970 17632 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:36937 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.252.62:36937: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:29.891867 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.886234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:44831)
0807 00:35:29.886293 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.886307 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.886354 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.886551 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.886552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.886749 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.886808 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.886811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.887884 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.887885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.888487 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.888489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.889046 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.889047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.889113 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.889808 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.889814 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.891806 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 00:35:29.892052 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:29.886329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:44831 (local address 127.7.252.62:36937)
0807 00:35:29.886401 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.886404 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.886413 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:29.886446 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.886448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.886460 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.886531 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.886890 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.887769 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.888589 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.888936 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.889022 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.891960 (+ 2938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:44831: BlockingRecv error: recv got EOF from 127.7.252.2:44831 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:29.898206 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:29.892407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:58307)
0807 00:35:29.892464 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:29.892475 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:29.892517 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:29.892699 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:29.892700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:29.892876 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:29.892912 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.892914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.893972 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.893973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.894633 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:29.894635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.895261 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.895263 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:29.895317 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.895830 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:29.895836 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:29.898121 (+ 2285us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 00:35:29.898360 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:29.892500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58307 (local address 127.7.252.62:36937)
0807 00:35:29.892549 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:29.892551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:29.892561 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:29.892588 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:29.892589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:29.892600 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:29.892652 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:29.892995 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.893842 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.894803 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:29.895117 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:29.895190 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:29.898246 (+ 3056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:58307: BlockingRecv error: recv got EOF from 127.7.252.2:58307 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260807 00:35:29.898471 17632 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 00:35:29.971231 17635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:29.971485 17635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:29.971514 17635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:29.972811 17635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:29.972863 17635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:29.972893 17635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:29.974496 17635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/krb5kdc/oryx_127.7.252.3.keytab
--principal=oryx/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:45729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=36959
--tserver_master_addrs=127.7.252.62:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:29.974872 17635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:29.975176 17635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:29.980994 17640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:29.981025 17641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.981317 17635 server_base.cc:1034] running on GCE node
W20260807 00:35:29.981025 17643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:29.981698 17635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:29.982053 17635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:29.983208 17635 hybrid_clock.cc:648] HybridClock initialized: now 1786062929983180 us; error 63 us; skew 500 ppm
Aug 07 00:35:29 dist-test-slave-csg5 krb5kdc[16753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062929, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:29.986572 17635 init.cc:377] Logged in from keytab as oryx/127.7.252.3@KRBTEST.COM (short username oryx)
I20260807 00:35:29.987103 17635 webserver.cc:460] Webserver started at http://127.7.252.3:36959/ using document root <none> and password file <none>
I20260807 00:35:29.987380 17635 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:29.987476 17635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:29.988943 17635 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:29.989732 17650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:29.989969 17635 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:29.990078 17635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "cf0b85d13f744a10afb8931702e94083"
format_stamp: "Formatted at 2026-08-07 00:35:29 on dist-test-slave-csg5"
server_key: "c380308888c4e2ec6a272f70cb8591ff"
server_key_iv: "5edc470476bb7521f3b9dc0f2863920c"
server_key_version: "encryptionkey@0"
I20260807 00:35:29.990543 17635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:30.015031 17635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:30.017669 17635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:30.017802 17635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:30.018054 17635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:30.018371 17635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:30.018407 17635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:30.018432 17635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:30.018445 17635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:30.025079 17635 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:45729
I20260807 00:35:30.025174 17765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:45729 every 8 connection(s)
I20260807 00:35:30.025554 17635 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:30.028354 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17635
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:30.035301 17768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:30.026399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:54267)
0807 00:35:30.026569 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:30.026612 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:30.027126 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:30.027395 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:30.027398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:30.028066 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:30.028401 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.028409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.029494 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.029495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.030693 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.030697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.031176 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.031177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.031411 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.032146 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:30.032157 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:30.035054 (+ 2897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
W20260807 00:35:30.035387 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:30.026433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:54267 (local address 127.7.252.62:36937)
0807 00:35:30.026542 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:30.026544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:30.026730 (+ 186us) server_negotiation.cc:407] Connection header received
0807 00:35:30.027240 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:30.027241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:30.027253 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:30.027342 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:30.028548 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.029357 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.030807 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.031082 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.031144 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.035214 (+ 4070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:54267: BlockingRecv error: recv got EOF from 127.7.252.3:54267 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 00:35:30.035528 17766 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:36937 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.252.62:36937: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
I20260807 00:35:30.038371 17770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:30.028930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58362 (local address 127.7.252.62:36937)
0807 00:35:30.029053 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:30.029056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:30.029065 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:30.029090 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:30.029093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:30.029107 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:30.029163 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:30.029996 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.030741 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.031932 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.032268 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.032353 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.034281 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:30.034286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:30.034286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:30.034310 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:30.036648 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:30.037087 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:30.037091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:30.037092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:30.037220 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:30.037502 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:30.037503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:30.037503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:30.037839 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:30.037989 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:30.038155 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 00:35:30.038247 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:30.040750 17768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:30.035783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:60765)
0807 00:35:30.035835 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:30.035845 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:30.035885 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:30.036065 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:30.036067 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:30.036199 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:30.036258 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.036260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.037078 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.037079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.037840 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.037844 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.038326 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.038327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.038396 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.038888 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:30.038894 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:30.040699 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 00:35:30.040936 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:30.035882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:60765 (local address 127.7.252.62:36937)
0807 00:35:30.035936 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:30.035938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:30.035949 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:30.035977 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:30.035977 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:30.035985 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:30.036034 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:30.036348 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.037004 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.037948 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.038235 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.038319 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.040870 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:60765: BlockingRecv error: recv got EOF from 127.7.252.3:60765 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:30.046039 17768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:30.041028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:41045)
0807 00:35:30.041091 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:30.041124 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:30.041174 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:30.041506 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:30.041507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:30.041623 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:30.041654 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.041655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.042385 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.042386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.042969 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.042972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.043344 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.043345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.043386 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.043872 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:30.043877 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:30.045984 (+ 2107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 00:35:30.046228 17499 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:30.041151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:41045 (local address 127.7.252.62:36937)
0807 00:35:30.041378 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:30.041380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:30.041388 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:30.041405 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:30.041405 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:30.041413 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:30.041463 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:30.041747 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.042298 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.043054 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.043238 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.043304 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.046161 (+ 2857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:41045: BlockingRecv error: recv got EOF from 127.7.252.3:41045 (error 108)
Metrics: {"server-negotiator.queue_time_us":137}
W20260807 00:35:30.046397 17766 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:30.756726 17771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:30.751560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:54329)
0807 00:35:30.751738 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:30.751754 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:30.751838 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:30.751976 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:30.751977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:30.752157 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:30.752211 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.752212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.752945 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.752946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.753532 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.753535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.753983 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.753984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.754033 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.754648 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:30.754692 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:30.756652 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":82,"threads_started":1}
W20260807 00:35:30.756866 17772 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:30.751633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:54329 (local address 127.7.252.62:36937)
0807 00:35:30.751788 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:30.751790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:30.751818 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:35:30.751886 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:30.751886 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:30.751896 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:30.751954 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:30.752283 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.752859 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.753627 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.753838 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.753898 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.756772 (+ 2874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:54329: BlockingRecv error: recv got EOF from 127.7.252.1:54329 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":106,"threads_started":1}
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:30 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:30.904493 17773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:30.898986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:54769)
0807 00:35:30.899216 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:30.899230 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:30.899390 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:30.899612 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:30.899613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:30.899841 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:30.899893 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.899895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.900587 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.900588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.901154 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:30.901156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.901535 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.901536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:30.901590 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.902169 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:30.902175 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:30.904367 (+ 2192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":113,"threads_started":1}
W20260807 00:35:30.904549 17772 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:30.899123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:54769 (local address 127.7.252.62:36937)
0807 00:35:30.899220 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:30.899223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:30.899370 (+ 147us) server_negotiation.cc:407] Connection header received
0807 00:35:30.899504 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:30.899505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:30.899532 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:30.899604 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:30.899987 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.900499 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.901246 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:30.901456 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:30.901537 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:30.904470 (+ 2933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:54769: BlockingRecv error: recv got EOF from 127.7.252.2:54769 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 00:35:31 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:31 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:31.052913 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:31.046892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:59633)
0807 00:35:31.047088 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:31.047103 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:31.047234 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:31.047527 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:31.047528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:31.047714 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:31.047769 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:31.047771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.048464 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.048465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:31.049039 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:31.049041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.049467 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.049469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:31.049526 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:31.050169 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:31.050178 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:31.052793 (+ 2615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":113,"threads_started":1}
W20260807 00:35:31.052968 17772 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:31.047007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:59633 (local address 127.7.252.62:36937)
0807 00:35:31.047096 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:31.047099 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:31.047244 (+ 145us) server_negotiation.cc:407] Connection header received
0807 00:35:31.047399 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:31.047400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:31.047422 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:31.047482 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:31.047855 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.048377 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.049150 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.049364 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.049429 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:31.052893 (+ 3464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:59633: BlockingRecv error: recv got EOF from 127.7.252.3:59633 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 07 00:35:31 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:31 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
W20260807 00:35:31.763453 17776 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:31.757634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:41361 (local address 127.7.252.62:36937)
0807 00:35:31.757835 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:31.757837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:31.757847 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:31.757874 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:31.757875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:31.757886 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:31.757954 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:31.758361 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.758971 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.759787 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.760020 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.760087 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:31.763387 (+ 3300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:41361: BlockingRecv error: recv got EOF from 127.7.252.1:41361 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":80,"threads_started":1}
I20260807 00:35:31.763458 17775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:31.757495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:41361)
0807 00:35:31.757735 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:31.757750 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:31.757823 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:31.758012 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:31.758013 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:31.758196 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:31.758248 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:31.758250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.759080 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.759081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:31.759683 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:31.759686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.760122 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.760123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:31.760175 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:31.760964 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:31.760970 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:31.763353 (+ 2383us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
Aug 07 00:35:31 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:31 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:31.910279 17777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:31.905315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:38349)
0807 00:35:31.905537 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:31.905552 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:31.905630 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:31.905776 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:31.905776 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:31.905956 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:31.906011 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:31.906013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.906843 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.906849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:31.907371 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:31.907373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.907749 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.907750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:31.907819 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:31.908315 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:31.908325 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:31.910172 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":92,"threads_started":1}
W20260807 00:35:31.910394 17776 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:31.905507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:38349 (local address 127.7.252.62:36937)
0807 00:35:31.905574 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:31.905576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:31.905624 (+ 48us) server_negotiation.cc:407] Connection header received
0807 00:35:31.905681 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:31.905682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:31.905693 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:31.905750 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:31.906086 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.906716 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.907472 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:31.907672 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:31.907748 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:31.910293 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:38349: BlockingRecv error: recv got EOF from 127.7.252.2:38349 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 00:35:32 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:32 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:32.058100 17778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:32.053465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:56579)
0807 00:35:32.053621 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:32.053633 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:32.053687 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:32.053828 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:32.053828 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:32.053997 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:32.054047 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:32.054048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.054742 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.054743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:32.055295 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:32.055297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.055641 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.055642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:32.055695 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:32.056252 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:32.056258 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:32.058031 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":61,"threads_started":1}
W20260807 00:35:32.058243 17776 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:32.053605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:56579 (local address 127.7.252.62:36937)
0807 00:35:32.053659 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:32.053661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:32.053672 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:32.053733 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:32.053733 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:32.053745 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:32.053793 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:32.054114 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.054616 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.055372 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.055557 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.055608 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:32.058152 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:56579: BlockingRecv error: recv got EOF from 127.7.252.3:56579 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 07 00:35:32 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:32 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:32.769246 17779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:32.764069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:34729)
0807 00:35:32.764351 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:32.764363 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:32.764430 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:32.764593 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:32.764594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:32.764765 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:32.764820 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:32.764822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.765579 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.765580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:32.766115 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:32.766117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.766474 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.766474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:32.766519 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:32.767033 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:32.767038 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:32.769183 (+ 2145us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":81,"threads_started":1}
W20260807 00:35:32.769562 17780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:32.764165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:34729 (local address 127.7.252.62:36937)
0807 00:35:32.764306 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:32.764308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:32.764414 (+ 106us) server_negotiation.cc:407] Connection header received
0807 00:35:32.764488 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:32.764488 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:32.764500 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:32.764552 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:32.764931 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.765503 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.766191 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.766402 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.766458 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:32.769487 (+ 3029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:34729: BlockingRecv error: recv got EOF from 127.7.252.1:34729 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":101,"threads_started":1}
Aug 07 00:35:32 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:32 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:32.916102 17781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:32.910834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:49833)
0807 00:35:32.910990 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:32.911002 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:32.911095 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:32.911266 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:32.911267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:32.911460 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:32.911510 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:32.911512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.912240 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.912242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:32.912816 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:32.912825 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.913208 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.913209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:32.913279 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:32.913864 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:32.913869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:32.915981 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
W20260807 00:35:32.916157 17780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:32.910906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:49833 (local address 127.7.252.62:36937)
0807 00:35:32.910969 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:32.910971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:32.911077 (+ 106us) server_negotiation.cc:407] Connection header received
0807 00:35:32.911157 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:32.911158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:32.911173 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:32.911243 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:32.911599 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.912144 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.912919 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:32.913121 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:32.913199 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:32.916087 (+ 2888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:49833: BlockingRecv error: recv got EOF from 127.7.252.2:49833 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 07 00:35:33 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:33 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:33.064086 17782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:33.058621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:51771)
0807 00:35:33.058805 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:33.058861 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:33.058935 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:33.059074 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:33.059075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:33.059244 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:33.059295 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:33.059296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.060139 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.060141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:33.060790 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:33.060793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.061275 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.061276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:33.061326 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:33.061812 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:33.061817 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:33.063956 (+ 2139us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":134,"threads_started":1}
W20260807 00:35:33.064136 17780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:33.058760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:51771 (local address 127.7.252.62:36937)
0807 00:35:33.058809 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:33.058812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:33.058917 (+ 105us) server_negotiation.cc:407] Connection header received
0807 00:35:33.058981 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:33.058982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:33.058994 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:33.059053 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:33.059392 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.060014 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.060889 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.061097 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.061162 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:33.064059 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:51771: BlockingRecv error: recv got EOF from 127.7.252.3:51771 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 07 00:35:33 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:33 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:33.775707 17783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:33.769999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:51751)
0807 00:35:33.770193 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:33.770207 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:33.770306 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:33.770527 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:33.770528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:33.770835 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:33.770901 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:33.770905 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.771700 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.771701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:33.772249 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:33.772250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.772682 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.772684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:33.772761 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:33.773314 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:33.773319 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:33.775643 (+ 2324us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":79,"threads_started":1}
W20260807 00:35:33.775934 17784 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:33.770128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:51751 (local address 127.7.252.62:36937)
0807 00:35:33.770301 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:33.770303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:33.770315 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:35:33.770417 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:33.770418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:33.770432 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:33.770504 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:33.770999 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.771607 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.772343 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.772556 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.772621 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:33.775838 (+ 3217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:51751: BlockingRecv error: recv got EOF from 127.7.252.1:51751 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":79,"threads_started":1}
Aug 07 00:35:33 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:33 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:33.927357 17785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:33.916875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:52267)
0807 00:35:33.917063 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:33.917083 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:33.917144 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:33.917460 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:33.917462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:33.917643 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:33.917697 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:33.917699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.918539 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.918540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:33.919168 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:33.919170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.919592 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.919593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:33.919650 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:33.924977 (+ 5327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:33.924985 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:33.927290 (+ 2305us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":132,"threads_started":1}
W20260807 00:35:33.927558 17784 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:33.916982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:52267 (local address 127.7.252.62:36937)
0807 00:35:33.917092 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:33.917094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:33.917134 (+ 40us) server_negotiation.cc:407] Connection header received
0807 00:35:33.917324 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:33.917325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:33.917339 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:33.917413 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:33.917796 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.918450 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.919286 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:33.919481 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:33.919553 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:33.927469 (+ 7916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:52267: BlockingRecv error: recv got EOF from 127.7.252.2:52267 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 00:35:34 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:34 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:34.070647 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:34.064747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:58443)
0807 00:35:34.064911 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:34.064925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:34.065013 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:34.065196 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:34.065198 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:34.065416 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:34.065483 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:34.065485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.066513 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.066514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:34.067147 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:34.067149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.067683 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.067685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:34.067752 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:34.068375 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:34.068381 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:34.070565 (+ 2184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
W20260807 00:35:34.070968 17784 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:34.064806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:58443 (local address 127.7.252.62:36937)
0807 00:35:34.064878 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:34.064880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:34.064984 (+ 104us) server_negotiation.cc:407] Connection header received
0807 00:35:34.065063 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:34.065064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:34.065081 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:34.065184 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:34.065585 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.066413 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.067241 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.067576 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.067682 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:34.070890 (+ 3208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:58443: BlockingRecv error: recv got EOF from 127.7.252.3:58443 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 00:35:34 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:34 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:34.781826 17787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:34.776397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:45299)
0807 00:35:34.776684 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:34.776697 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:34.776802 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:34.776961 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:34.776962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:34.777147 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:34.777200 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:34.777202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.777921 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.777922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:34.778536 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:34.778538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.778949 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.778950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:34.778999 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:34.779538 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:34.779543 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:34.781752 (+ 2209us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":203,"threads_started":1}
W20260807 00:35:34.782007 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:34.776642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:45299 (local address 127.7.252.62:36937)
0807 00:35:34.776820 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:34.776821 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:34.776846 (+ 25us) server_negotiation.cc:407] Connection header received
0807 00:35:34.776872 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:34.776872 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:34.776883 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:34.776935 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:34.777307 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.777832 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.778641 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.778873 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.778936 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:34.781912 (+ 2976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:45299: BlockingRecv error: recv got EOF from 127.7.252.1:45299 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
Aug 07 00:35:34 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:34 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:34.933279 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:34.927945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:56927)
0807 00:35:34.928092 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:34.928126 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:34.928193 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:34.928395 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:34.928397 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:34.928574 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:34.928622 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:34.928624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.929311 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.929312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:34.929844 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:34.929846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.930221 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.930223 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:34.930293 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:34.930863 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:34.930868 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:34.933167 (+ 2299us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
W20260807 00:35:34.933521 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:34.928089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:56927 (local address 127.7.252.62:36937)
0807 00:35:34.928164 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:34.928166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:34.928177 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:34.928288 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:34.928289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:34.928303 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:34.928352 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:34.928707 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.929215 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.929934 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:34.930138 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:34.930217 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:34.933428 (+ 3211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:56927: BlockingRecv error: recv got EOF from 127.7.252.2:56927 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 00:35:35 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:35 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:35.076870 17790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:35.071366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:35653)
0807 00:35:35.071522 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:35.071535 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:35.071598 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:35.071842 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:35.071843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:35.072018 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:35.072082 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:35.072084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.072902 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.072903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:35.073544 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:35.073547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.073929 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.073930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:35.073971 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:35.074485 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:35.074489 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:35.076780 (+ 2291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
W20260807 00:35:35.076992 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:35.071584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:35653 (local address 127.7.252.62:36937)
0807 00:35:35.071660 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:35.071662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:35.071671 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:35.071700 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:35.071701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:35.071715 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:35.071785 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:35.072183 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.072779 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.073629 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.073852 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.073919 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:35.076913 (+ 2994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:35653: BlockingRecv error: recv got EOF from 127.7.252.3:35653 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 00:35:35 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:35 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:35.788139 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:35.782449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:47391)
0807 00:35:35.782598 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:35.782609 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:35.782733 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:35.782931 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:35.782932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:35.783180 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:35.783236 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:35.783238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.784158 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.784159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:35.784880 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:35.784883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.785307 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.785308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:35.785364 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:35.786014 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:35.786021 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:35.788073 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
W20260807 00:35:35.788383 17792 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:35.782562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:47391 (local address 127.7.252.62:36937)
0807 00:35:35.782724 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:35.782725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:35.782735 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:35.782823 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:35.782824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:35.782835 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:35.782900 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:35.783370 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.784032 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.784995 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.785212 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.785273 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:35.788311 (+ 3038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:47391: BlockingRecv error: recv got EOF from 127.7.252.1:47391 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":78,"threads_started":1}
Aug 07 00:35:35 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:35 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:35.940203 17793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:35.933936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:44913)
0807 00:35:35.934116 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:35.934127 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:35.934182 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:35.934468 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:35.934470 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:35.934753 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:35.934816 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:35.934819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.935801 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.935802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:35.936514 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:35.936517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.937079 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.937080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:35.937152 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:35.937864 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:35.937869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:35.940136 (+ 2267us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
W20260807 00:35:35.940403 17792 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:35.934085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:44913 (local address 127.7.252.62:36937)
0807 00:35:35.934265 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:35.934268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:35.934279 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:35.934314 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:35.934315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:35.934326 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:35.934406 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:35.934944 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.935667 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.936610 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:35.936985 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:35.937061 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:35.940324 (+ 3263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:44913: BlockingRecv error: recv got EOF from 127.7.252.2:44913 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 00:35:36 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:36 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:36.082574 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:36.077429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:59617)
0807 00:35:36.077609 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:36.077625 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:36.077746 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:36.077922 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:36.077923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:36.078109 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:36.078162 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:36.078165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.078972 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.078973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:36.079493 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:36.079495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.079899 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.079900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:36.079966 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:36.080412 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:36.080417 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:36.082513 (+ 2096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
W20260807 00:35:36.082785 17792 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:36.077541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:59617 (local address 127.7.252.62:36937)
0807 00:35:36.077642 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:36.077645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:36.077725 (+ 80us) server_negotiation.cc:407] Connection header received
0807 00:35:36.077830 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:36.077831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:36.077846 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:36.077904 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:36.078277 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.078878 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.079602 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.079812 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.079887 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:36.082653 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:59617: BlockingRecv error: recv got EOF from 127.7.252.3:59617 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 00:35:36 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:36 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:36.793748 17795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:36.788723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:56951)
0807 00:35:36.788887 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:36.788901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:36.788982 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:36.789130 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:36.789130 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:36.789304 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:36.789364 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:36.789365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.790019 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.790020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:36.790559 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:36.790561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.790968 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.790969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:36.791010 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:36.791528 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:36.791533 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:36.793688 (+ 2155us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
W20260807 00:35:36.793938 17797 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:36.788835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:56951 (local address 127.7.252.62:36937)
0807 00:35:36.788979 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:36.788981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:36.788991 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:36.789037 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:36.789037 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:36.789050 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:36.789110 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:36.789431 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.789941 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.790639 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.790901 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.790958 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:36.793828 (+ 2870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:56951: BlockingRecv error: recv got EOF from 127.7.252.1:56951 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
Aug 07 00:35:36 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:36 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:36.946287 17798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:36.940804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:41311)
0807 00:35:36.940990 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:36.941001 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:36.941070 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:36.941221 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:36.941222 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:36.941436 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:36.941492 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:36.941494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.942351 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.942352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:36.942925 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:36.942927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.943406 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.943408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:36.943460 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:36.944028 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:36.944033 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:36.946194 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":119,"threads_started":1}
W20260807 00:35:36.946365 17797 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:36.940936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:41311 (local address 127.7.252.62:36937)
0807 00:35:36.940995 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:36.940997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:36.941048 (+ 51us) server_negotiation.cc:407] Connection header received
0807 00:35:36.941141 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:36.941141 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:36.941152 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:36.941198 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:36.941568 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.942088 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.943008 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:36.943203 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:36.943261 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:36.946305 (+ 3044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:41311: BlockingRecv error: recv got EOF from 127.7.252.2:41311 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 07 00:35:37 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:37 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:37.088027 17799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:37.083111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:59331)
0807 00:35:37.083243 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:37.083255 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:37.083321 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:37.083532 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:37.083533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:37.083752 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:37.083818 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:37.083820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.084635 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.084636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:37.085263 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:37.085265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.085591 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.085591 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:37.085631 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:37.086090 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:37.086093 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:37.087964 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":79,"threads_started":1}
W20260807 00:35:37.088178 17797 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:37.083188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:59331 (local address 127.7.252.62:36937)
0807 00:35:37.083237 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:37.083239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:37.083408 (+ 169us) server_negotiation.cc:407] Connection header received
0807 00:35:37.083434 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:37.083435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:37.083449 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:37.083510 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:37.083899 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.084540 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.085346 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.085529 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.085589 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:37.088094 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:59331: BlockingRecv error: recv got EOF from 127.7.252.3:59331 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 07 00:35:37 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:37 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:37.799551 17800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:37.794407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:36501)
0807 00:35:37.794607 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:37.794624 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:37.794725 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:37.794933 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:37.794934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:37.795151 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:37.795202 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:37.795204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.795958 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.795959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:37.796553 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:37.796556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.796940 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.796941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:37.797002 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:37.797537 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:37.797542 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:37.799449 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":84,"threads_started":1}
W20260807 00:35:37.799611 17801 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:37.794584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:36501 (local address 127.7.252.62:36937)
0807 00:35:37.794759 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:37.794761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:37.794770 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:37.794798 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:37.794799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:37.794829 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:37.794905 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:37.795293 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.795884 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.796653 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.796863 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.796940 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:37.799536 (+ 2596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:36501: BlockingRecv error: recv got EOF from 127.7.252.1:36501 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
Aug 07 00:35:37 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:37 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:37.952930 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:37.946936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:58513)
0807 00:35:37.947120 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:37.947132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:37.947241 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:37.947405 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:37.947406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:37.947600 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:37.947650 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:37.947652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.948565 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.948567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:37.949101 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:37.949103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.949502 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.949503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:37.949569 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:37.950309 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:37.950316 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:37.952866 (+ 2550us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":119,"threads_started":1}
W20260807 00:35:37.953186 17801 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:37.947028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58513 (local address 127.7.252.62:36937)
0807 00:35:37.947106 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:37.947109 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:37.947220 (+ 111us) server_negotiation.cc:407] Connection header received
0807 00:35:37.947325 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:37.947326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:37.947341 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:37.947398 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:37.947734 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.948463 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.949192 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:37.949410 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:37.949498 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:37.953091 (+ 3593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:58513: BlockingRecv error: recv got EOF from 127.7.252.2:58513 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 07 00:35:38 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:38 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:38.093899 17803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:38.088559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:41275)
0807 00:35:38.088701 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:38.088713 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:38.088772 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:38.088899 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:38.088899 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:38.089067 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:38.089116 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:38.089117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.089888 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.089890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:38.090474 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:38.090477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.090913 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.090914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:38.090955 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:38.091555 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:38.091560 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:38.093784 (+ 2224us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
W20260807 00:35:38.093963 17801 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:38.088634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:41275 (local address 127.7.252.62:36937)
0807 00:35:38.088746 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:38.088748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:38.088767 (+ 19us) server_negotiation.cc:407] Connection header received
0807 00:35:38.088820 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:38.088821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:38.088835 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:38.088892 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:38.089275 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.089783 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.090565 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.090841 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.090905 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:38.093890 (+ 2985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:41275: BlockingRecv error: recv got EOF from 127.7.252.3:41275 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 00:35:38 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:38 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:38.805747 17804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:38.800113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:38517)
0807 00:35:38.800307 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:38.800335 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:38.800414 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:38.800628 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:38.800629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:38.800814 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:38.800865 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:38.800867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.801631 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.801632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:38.802186 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:38.802188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.802629 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.802630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:38.802714 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:38.803340 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:38.803347 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:38.805684 (+ 2337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":103,"threads_started":1}
W20260807 00:35:38.805900 17805 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:38.800211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:38517 (local address 127.7.252.62:36937)
0807 00:35:38.800411 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:38.800413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:38.800425 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:35:38.800472 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:38.800472 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:38.800484 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:38.800556 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:38.800951 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.801514 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.802278 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.802526 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.802584 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:38.805796 (+ 3212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:38517: BlockingRecv error: recv got EOF from 127.7.252.1:38517 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
Aug 07 00:35:38 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:38 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:38.963299 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:38.953537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:36311)
0807 00:35:38.953741 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:38.953752 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:38.953849 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:38.954138 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:38.954139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:38.954407 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:38.954460 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:38.954462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.955586 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.955588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:38.956532 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:38.956536 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.957091 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.957093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:38.957159 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:38.960883 (+ 3724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:38.960891 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:38.963231 (+ 2340us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":111,"threads_started":1}
W20260807 00:35:38.963495 17805 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:38.953669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:36311 (local address 127.7.252.62:36937)
0807 00:35:38.953737 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:38.953741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:38.953837 (+ 96us) server_negotiation.cc:407] Connection header received
0807 00:35:38.953948 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:38.953949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:38.953965 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:38.954063 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:38.954581 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.955479 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.956635 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:38.957003 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:38.957090 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:38.963395 (+ 6305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:36311: BlockingRecv error: recv got EOF from 127.7.252.2:36311 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 00:35:39 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:39 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:39.100123 17807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:39.094514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:40211)
0807 00:35:39.094752 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:39.094771 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:39.094859 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:39.095020 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:39.095021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:39.095211 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:39.095261 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:39.095263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.096065 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.096067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:39.096855 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:39.096858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.097412 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.097413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:39.097459 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:39.098005 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:39.098010 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:39.100062 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":112,"threads_started":1}
W20260807 00:35:39.100337 17805 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:39.094622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:40211 (local address 127.7.252.62:36937)
0807 00:35:39.094712 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:39.094715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:39.094838 (+ 123us) server_negotiation.cc:407] Connection header received
0807 00:35:39.094920 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:39.094921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:39.094943 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:39.095011 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:39.095429 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.095971 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.096990 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.097331 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.097397 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:39.100210 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:40211: BlockingRecv error: recv got EOF from 127.7.252.3:40211 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 00:35:39 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:39 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:39.812124 17808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:39.806489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:44413)
0807 00:35:39.806694 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:39.806708 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:39.806783 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:39.806965 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:39.806966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:39.807138 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:39.807191 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:39.807193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.808235 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.808236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:39.808788 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:39.808790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.809177 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.809178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:39.809223 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:39.809779 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:39.809785 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:39.812043 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
W20260807 00:35:39.812279 17809 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:39.806636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:44413 (local address 127.7.252.62:36937)
0807 00:35:39.806826 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:39.806828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:39.806839 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:39.806867 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:39.806868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:39.806880 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:39.806948 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:39.807302 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.808116 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.808881 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.809100 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.809165 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:39.812181 (+ 3016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:44413: BlockingRecv error: recv got EOF from 127.7.252.1:44413 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":116,"threads_started":1}
Aug 07 00:35:39 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:39 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:39.969592 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:39.963994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:59223)
0807 00:35:39.964142 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:39.964155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:39.964223 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:39.964401 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:39.964402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:39.964605 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:39.964686 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:39.964689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.965513 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.965514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:39.966109 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:39.966110 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.966549 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.966551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:39.966621 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:39.967203 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:39.967208 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:39.969512 (+ 2304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
W20260807 00:35:39.969798 17809 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:39.964098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:59223 (local address 127.7.252.62:36937)
0807 00:35:39.964252 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:39.964254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:39.964264 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:39.964311 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:39.964312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:39.964324 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:39.964381 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:39.964779 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.965399 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.966205 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:39.966452 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:39.966540 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:39.969711 (+ 3171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:59223: BlockingRecv error: recv got EOF from 127.7.252.2:59223 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Aug 07 00:35:40 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:40 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:40.105883 17811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:40.100601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:34835)
0807 00:35:40.100826 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:40.100839 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:40.100930 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:40.101092 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:40.101093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:40.101289 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:40.101348 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:40.101350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.102061 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.102062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:40.102614 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:40.102617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.103055 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.103056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:40.103129 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:40.103606 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:40.103611 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:40.105763 (+ 2152us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":113,"threads_started":1}
W20260807 00:35:40.105922 17809 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:40.100747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:34835 (local address 127.7.252.62:36937)
0807 00:35:40.100827 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:40.100829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:40.100909 (+ 80us) server_negotiation.cc:407] Connection header received
0807 00:35:40.101009 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:40.101010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:40.101025 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:40.101072 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:40.101438 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.101967 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.102762 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.102962 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.103054 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:40.105858 (+ 2804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:34835: BlockingRecv error: recv got EOF from 127.7.252.3:34835 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 00:35:40 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:40 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:40.817792 17812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:40.812868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:51821)
0807 00:35:40.813025 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:40.813037 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:40.813100 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:40.813269 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:40.813270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:40.813450 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:40.813508 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:40.813510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.814217 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.814218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:40.814831 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:40.814833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.815192 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.815193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:40.815233 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:40.815729 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:40.815734 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:40.817676 (+ 1942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
W20260807 00:35:40.817842 17813 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:40.812942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:51821 (local address 127.7.252.62:36937)
0807 00:35:40.813101 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:40.813103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:40.813153 (+ 50us) server_negotiation.cc:407] Connection header received
0807 00:35:40.813180 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:40.813181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:40.813191 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:40.813245 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:40.813584 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.814130 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.814913 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.815117 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.815181 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:40.817766 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:51821: BlockingRecv error: recv got EOF from 127.7.252.1:51821 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
Aug 07 00:35:40 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:40 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:40.975737 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:40.970255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:47565)
0807 00:35:40.970437 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:40.970452 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:40.970549 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:40.970879 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:40.970881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:40.971081 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:40.971130 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:40.971132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.971871 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.971873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:40.972422 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:40.972424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.972883 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.972884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:40.972950 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:40.973537 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:40.973542 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:40.975615 (+ 2073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":118,"threads_started":1}
W20260807 00:35:40.975802 17813 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:40.970456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:47565 (local address 127.7.252.62:36937)
0807 00:35:40.970532 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:40.970534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:40.970546 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:35:40.970626 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:40.970628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:40.970642 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:40.970854 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:40.971229 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.971775 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.972567 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:40.972787 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:40.972881 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:40.975734 (+ 2853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:47565: BlockingRecv error: recv got EOF from 127.7.252.2:47565 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 00:35:41 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:41 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:41.111872 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:41.106574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:53583)
0807 00:35:41.106727 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:41.106740 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:41.106799 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:41.107016 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:41.107017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:41.107192 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:41.107242 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:41.107243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.107947 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.107948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:41.108506 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:41.108508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.108884 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.108885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:41.108926 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:41.109413 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:41.109418 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:41.111798 (+ 2380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":122,"threads_started":1}
W20260807 00:35:41.111992 17813 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:41.106789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:53583 (local address 127.7.252.62:36937)
0807 00:35:41.106871 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:41.106873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:41.106884 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:41.106913 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:41.106914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:41.106927 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:41.106995 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:41.107315 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.107867 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.108600 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.108812 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.108876 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:41.111909 (+ 3033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:53583: BlockingRecv error: recv got EOF from 127.7.252.3:53583 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 00:35:41 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:41 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:41.823741 17816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:41.818367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:45595)
0807 00:35:41.818529 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:41.818540 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:41.818599 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:41.818789 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:41.818790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:41.818971 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:41.819022 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:41.819023 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.819862 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.819864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:41.820495 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:41.820498 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.820909 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.820911 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:41.820966 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:41.821593 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:41.821598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:41.823668 (+ 2070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
W20260807 00:35:41.823966 17817 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:41.818481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:45595 (local address 127.7.252.62:36937)
0807 00:35:41.818598 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:41.818600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:41.818610 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:41.818684 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:41.818685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:41.818697 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:41.818751 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:41.819108 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.819703 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.820590 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.820808 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.820882 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:41.823830 (+ 2948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:45595: BlockingRecv error: recv got EOF from 127.7.252.1:45595 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":56,"threads_started":1}
Aug 07 00:35:41 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:41 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:41.982082 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:41.976310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:46773)
0807 00:35:41.976550 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:41.976563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:41.976663 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:41.976850 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:41.976851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:41.977056 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:41.977105 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:41.977107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.977976 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.977978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:41.978546 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:41.978548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.978978 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.978980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:41.979050 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:41.979633 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:41.979638 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:41.981955 (+ 2317us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":128,"threads_started":1}
W20260807 00:35:41.982198 17817 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:41.976446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:46773 (local address 127.7.252.62:36937)
0807 00:35:41.976530 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:41.976533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:41.976640 (+ 107us) server_negotiation.cc:407] Connection header received
0807 00:35:41.976739 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:41.976740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:41.976753 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:41.976837 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:41.977307 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.977876 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.978637 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:41.978888 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:41.978978 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:41.982084 (+ 3106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:46773: BlockingRecv error: recv got EOF from 127.7.252.2:46773 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 00:35:42 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:42 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:42.117774 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:42.112492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:45155)
0807 00:35:42.112734 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:42.112748 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:42.112870 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:42.113024 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:42.113025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:42.113223 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:42.113270 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:42.113272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.113988 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.113989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:42.114640 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:42.114643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.115063 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.115064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:42.115123 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:42.115597 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:42.115601 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:42.117701 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":140,"threads_started":1}
W20260807 00:35:42.117909 17817 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:42.112629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:45155 (local address 127.7.252.62:36937)
0807 00:35:42.112709 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:42.112711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:42.112847 (+ 136us) server_negotiation.cc:407] Connection header received
0807 00:35:42.112943 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:42.112943 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:42.112958 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:42.113008 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:42.113356 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.113894 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.114771 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.115003 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.115066 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:42.117821 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:45155: BlockingRecv error: recv got EOF from 127.7.252.3:45155 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 07 00:35:42 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:42 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:42.829485 17820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:42.824394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:44883)
0807 00:35:42.824586 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:42.824603 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:42.824680 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:42.824833 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:42.824834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:42.825014 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:42.825065 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:42.825067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.825797 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.825797 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:42.826502 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:42.826505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.826948 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.826950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:42.827001 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:42.827484 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:42.827489 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:42.829423 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":78,"threads_started":1}
W20260807 00:35:42.829659 17821 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:42.824430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:44883 (local address 127.7.252.62:36937)
0807 00:35:42.824628 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:42.824630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:42.824661 (+ 31us) server_negotiation.cc:407] Connection header received
0807 00:35:42.824747 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:42.824747 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:42.824759 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:42.824811 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:42.825135 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.825709 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.826583 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.826866 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.826927 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:42.829567 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:44883: BlockingRecv error: recv got EOF from 127.7.252.1:44883 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":116,"threads_started":1}
Aug 07 00:35:42 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:42 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:42.988247 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:42.982767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:58563)
0807 00:35:42.982940 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:42.982954 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:42.983042 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:42.983250 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:42.983251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:42.983484 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:42.983534 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:42.983536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.984213 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.984215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:42.984808 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:42.984810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.985253 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.985254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:42.985297 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:42.985947 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:42.985952 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:42.988136 (+ 2184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
W20260807 00:35:42.988297 17821 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:42.982931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58563 (local address 127.7.252.62:36937)
0807 00:35:42.983000 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:42.983002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:42.983020 (+ 18us) server_negotiation.cc:407] Connection header received
0807 00:35:42.983156 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:42.983156 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:42.983166 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:42.983219 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:42.983601 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.984105 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.984972 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:42.985183 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:42.985241 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:42.988223 (+ 2982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:58563: BlockingRecv error: recv got EOF from 127.7.252.2:58563 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 00:35:43 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:43 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:43.124480 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:43.118578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:34903)
0807 00:35:43.118853 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:43.118867 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:43.118948 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:43.119125 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:43.119126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:43.119505 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:43.119558 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:43.119560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.120402 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.120403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:43.121020 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:43.121022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.121462 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.121463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:43.121539 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:43.122089 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:43.122094 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:43.124349 (+ 2255us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":162,"threads_started":1}
W20260807 00:35:43.124533 17821 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:43.118697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:34903 (local address 127.7.252.62:36937)
0807 00:35:43.118769 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:43.118772 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:43.118995 (+ 223us) server_negotiation.cc:407] Connection header received
0807 00:35:43.119028 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:43.119029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:43.119045 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:43.119090 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:43.119742 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.120304 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.121131 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.121358 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.121460 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:43.124455 (+ 2995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:34903: BlockingRecv error: recv got EOF from 127.7.252.3:34903 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 07 00:35:43 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:43 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:43.835973 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:43.830195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:38363)
0807 00:35:43.830416 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:43.830429 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:43.830500 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:43.830703 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:43.830705 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:43.830889 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:43.830944 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:43.830946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.831713 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.831714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:43.832315 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:43.832317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.832774 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.832775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:43.832827 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:43.833552 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:43.833560 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:43.835853 (+ 2293us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":115,"threads_started":1}
W20260807 00:35:43.836025 17825 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:43.830325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:38363 (local address 127.7.252.62:36937)
0807 00:35:43.830495 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:43.830497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:43.830507 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:43.830558 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:43.830559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:43.830570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:43.830630 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:43.831021 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.831597 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.832436 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.832674 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.832754 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:43.835946 (+ 3192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:38363: BlockingRecv error: recv got EOF from 127.7.252.1:38363 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":102,"threads_started":1}
Aug 07 00:35:43 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:43 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:43.997866 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:43.988848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:45857)
0807 00:35:43.989011 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:43.989023 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:43.989080 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:43.989258 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:43.989259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:43.989461 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:43.989513 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:43.989515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.990320 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.990323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:43.991255 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:43.991258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.991734 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.991735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:43.991802 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:43.995722 (+ 3920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:43.995728 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:43.997772 (+ 2044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
W20260807 00:35:43.997972 17825 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:43.988941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:45857 (local address 127.7.252.62:36937)
0807 00:35:43.989117 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:43.989119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:43.989130 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:35:43.989160 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:43.989161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:43.989171 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:43.989241 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:43.989611 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.990205 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.991357 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:43.991635 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:43.991733 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:43.997898 (+ 6165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:45857: BlockingRecv error: recv got EOF from 127.7.252.2:45857 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
Aug 07 00:35:44 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:44 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.3@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:44.131754 17827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:44.125091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.3:44551)
0807 00:35:44.125252 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:44.125264 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:44.125337 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:44.125586 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:44.125588 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:44.125837 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:44.125899 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:44.125901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.126901 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.126902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:44.127861 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:44.127865 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.128396 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.128398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:44.128474 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:44.129080 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:44.129086 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:44.131627 (+ 2541us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
W20260807 00:35:44.131966 17825 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:44.125128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:44551 (local address 127.7.252.62:36937)
0807 00:35:44.125185 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:44.125187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:44.125316 (+ 129us) server_negotiation.cc:407] Connection header received
0807 00:35:44.125471 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:44.125472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:44.125493 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:44.125551 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:44.125996 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.126803 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.127975 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.128290 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.128375 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:44.131791 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.3:44551: BlockingRecv error: recv got EOF from 127.7.252.3:44551 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 07 00:35:44 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:44 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.1@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:44.842109 17828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:44.836847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.1:34039)
0807 00:35:44.837010 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:44.837023 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:44.837090 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:44.837319 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:44.837321 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:44.837522 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:44.837602 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:44.837604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.838350 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.838351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:44.838994 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:44.838996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.839381 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.839382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:44.839431 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:44.839960 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:44.839966 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:44.842028 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
W20260807 00:35:44.842240 17829 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:44.836913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:34039 (local address 127.7.252.62:36937)
0807 00:35:44.837088 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:44.837091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:44.837101 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:44.837155 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:44.837156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:44.837169 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:44.837240 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:44.837693 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.838232 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.839084 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.839281 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.839341 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:44.842148 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.1:34039: BlockingRecv error: recv got EOF from 127.7.252.1:34039 (error 108)
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":82,"threads_started":1}
Aug 07 00:35:44 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
Aug 07 00:35:45 dist-test-slave-csg5 krb5kdc[16753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.252.2@KRBTEST.COM for oryx/127.7.252.62@KRBTEST.COM, Server not found in Kerberos database
I20260807 00:35:45.003996 17830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:44.998514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36937 (local address 127.7.252.2:47349)
0807 00:35:44.998738 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:44.998757 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:44.998843 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:44.999038 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:44.999039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:44.999224 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:44.999275 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:44.999277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.999982 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:44.999984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.000583 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.000586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.001025 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.001027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.001094 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.001618 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:45.001623 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:45.003875 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.252.62:36937: Server oryx/127.7.252.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":100,"threads_started":1}
W20260807 00:35:45.004074 17829 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:44.998623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:47349 (local address 127.7.252.62:36937)
0807 00:35:44.998716 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:44.998718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:44.998824 (+ 106us) server_negotiation.cc:407] Connection header received
0807 00:35:44.998946 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:44.998947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:44.998959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:44.999020 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:44.999371 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:44.999881 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.000688 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.000910 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.001016 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.003995 (+ 2979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.252.2:47349: BlockingRecv error: recv got EOF from 127.7.252.2:47349 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 00:35:45.030211 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17343
I20260807 00:35:45.036399 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17500
I20260807 00:35:45.043260 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17635
I20260807 00:35:45.050006 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17271
2026-08-07T00:35:45Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17788 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T00:35:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:45Z Disabled control of system clock
I20260807 00:35:45.081867 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:45421
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:45421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 00:35:45.169687 17834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:45.169926 17834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:45.169950 17834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:45.171265 17834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:45.171314 17834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:45.171327 17834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:45.171340 17834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:45.171353 17834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:45.172748 17834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:45421
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:45421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:45.172976 17834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:45.173239 17834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:35:45.179217 17834 server_base.cc:1034] running on GCE node
W20260807 00:35:45.179370 17840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.179508 17843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.179543 17841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.179878 17834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:45.180161 17834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:45.181344 17834 hybrid_clock.cc:648] HybridClock initialized: now 1786062945181311 us; error 46 us; skew 500 ppm
I20260807 00:35:45.182924 17834 webserver.cc:460] Webserver started at http://127.7.252.62:37791/ using document root <none> and password file <none>
I20260807 00:35:45.183202 17834 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:45.183261 17834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:45.183465 17834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:45.184656 17834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "f41de4f97b5f491f8034da5609f4bdf9"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "7528f9b997ac798d15f478fe944d5998"
server_key_iv: "23dc466626cd447e1c0f66c030511422"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.185066 17834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "f41de4f97b5f491f8034da5609f4bdf9"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "7528f9b997ac798d15f478fe944d5998"
server_key_iv: "23dc466626cd447e1c0f66c030511422"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.186540 17834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:45.187484 17849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.187803 17834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:45.187915 17834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "f41de4f97b5f491f8034da5609f4bdf9"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "7528f9b997ac798d15f478fe944d5998"
server_key_iv: "23dc466626cd447e1c0f66c030511422"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.187999 17834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:45.205969 17834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:45.206360 17834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:45.206522 17834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:45.211665 17834 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:45421
I20260807 00:35:45.211849 17901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:45421 every 8 connection(s)
I20260807 00:35:45.212153 17834 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:45.212890 17902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:45.215920 17902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9: Bootstrap starting.
I20260807 00:35:45.216614 17902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:45.216958 17902 log.cc:824] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:45.217669 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17834
I20260807 00:35:45.217770 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:45.217872 17902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9: No bootstrap required, opened a new log
I20260807 00:35:45.217998 8176 external_mini_cluster.cc:1428] Setting key 5f02d393bd8653a73fde52d4be6773b2
I20260807 00:35:45.220403 17902 raft_consensus.cc:348] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41de4f97b5f491f8034da5609f4bdf9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45421 } }
I20260807 00:35:45.220593 17902 raft_consensus.cc:374] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:45.220642 17902 raft_consensus.cc:729] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f41de4f97b5f491f8034da5609f4bdf9, State: Initialized, Role: FOLLOWER
I20260807 00:35:45.220805 17902 consensus_queue.cc:260] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41de4f97b5f491f8034da5609f4bdf9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45421 } }
I20260807 00:35:45.220920 17902 raft_consensus.cc:388] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:45.220968 17902 raft_consensus.cc:482] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:45.221017 17902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:45.221655 17902 raft_consensus.cc:504] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41de4f97b5f491f8034da5609f4bdf9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45421 } }
I20260807 00:35:45.221786 17902 leader_election.cc:302] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f41de4f97b5f491f8034da5609f4bdf9; no voters:
I20260807 00:35:45.221978 17902 leader_election.cc:288] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:45.222040 17907 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:45.222296 17902 sys_catalog.cc:564] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:45.222323 17907 raft_consensus.cc:686] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [term 1 LEADER]: Becoming Leader. State: Replica: f41de4f97b5f491f8034da5609f4bdf9, State: Running, Role: LEADER
I20260807 00:35:45.222596 17907 consensus_queue.cc:237] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41de4f97b5f491f8034da5609f4bdf9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45421 } }
I20260807 00:35:45.223053 17908 sys_catalog.cc:455] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f41de4f97b5f491f8034da5609f4bdf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41de4f97b5f491f8034da5609f4bdf9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45421 } } }
I20260807 00:35:45.223155 17908 sys_catalog.cc:458] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:45.223321 17909 sys_catalog.cc:455] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f41de4f97b5f491f8034da5609f4bdf9. Latest consensus state: current_term: 1 leader_uuid: "f41de4f97b5f491f8034da5609f4bdf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41de4f97b5f491f8034da5609f4bdf9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45421 } } }
I20260807 00:35:45.223373 17909 sys_catalog.cc:458] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:45.223724 17916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:45.224294 17916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:45.226150 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.218603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46458 (local address 127.7.252.62:45421)
0807 00:35:45.218911 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:45.218920 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:45.218947 (+ 27us) server_negotiation.cc:407] Connection header received
0807 00:35:45.219431 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:45.219438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:45.219542 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:45.219658 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:45.219980 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.222084 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.223473 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.224165 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.224310 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.225133 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:45.225138 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:45.225138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:45.225424 (+ 286us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:45.225471 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:45.225487 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:45.225561 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:45.225664 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 00:35:45.225880 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":172,"threads_started":1}
I20260807 00:35:45.226440 17916 catalog_manager.cc:1347] Generated new cluster ID: b2ddbbc9c1df4baabab5b41407473edc
I20260807 00:35:45.226493 17916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:45.250465 17916 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:45.251143 17916 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:45.258199 17916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f41de4f97b5f491f8034da5609f4bdf9: Generated new TSK 0
I20260807 00:35:45.258447 17916 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:45.266780 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45421
--builtin_ntp_servers=127.7.252.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 00:35:45.355047 17926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:45.355273 17926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:45.355295 17926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:45.356503 17926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:45.356551 17926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:45.356578 17926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:45.357964 17926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:45.358237 17926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:45.358587 17926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:45.364167 17932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.364161 17931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.364166 17934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.364554 17926 server_base.cc:1034] running on GCE node
I20260807 00:35:45.364827 17926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:45.365130 17926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:45.366338 17926 hybrid_clock.cc:648] HybridClock initialized: now 1786062945366316 us; error 45 us; skew 500 ppm
I20260807 00:35:45.367832 17926 webserver.cc:460] Webserver started at http://127.7.252.1:34539/ using document root <none> and password file <none>
I20260807 00:35:45.368166 17926 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:45.368247 17926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:45.368412 17926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:45.369552 17926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "8b7ce11994274bebbb5285ec2746031e"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "db685d88c6b8132f883125c81fd4355a"
server_key_iv: "ba8c27dd46af5888471d01cf4d9654a6"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.369948 17926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "8b7ce11994274bebbb5285ec2746031e"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "db685d88c6b8132f883125c81fd4355a"
server_key_iv: "ba8c27dd46af5888471d01cf4d9654a6"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.371414 17926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:45.372258 17940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.372432 17926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 00:35:45.372545 17926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "8b7ce11994274bebbb5285ec2746031e"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "db685d88c6b8132f883125c81fd4355a"
server_key_iv: "ba8c27dd46af5888471d01cf4d9654a6"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.372627 17926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:45.384711 17926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:45.385087 17926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:45.385286 17926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:45.385542 17926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:45.385901 17926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:45.385960 17926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.386004 17926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:45.386029 17926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.392059 17926 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42083
I20260807 00:35:45.392177 18056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42083 every 8 connection(s)
I20260807 00:35:45.392642 17926 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:45.393893 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 17926
I20260807 00:35:45.394026 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:45.394245 8176 external_mini_cluster.cc:1428] Setting key f14277a2ec923905a21b0fe235fe1f70
I20260807 00:35:45.395351 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45421
--builtin_ntp_servers=127.7.252.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 00:35:45.398993 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.393578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:54921 (local address 127.7.252.62:45421)
0807 00:35:45.393634 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:45.393652 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:45.393887 (+ 235us) server_negotiation.cc:407] Connection header received
0807 00:35:45.394576 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:45.394578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:45.394596 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:45.394670 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:45.395393 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.395908 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.397029 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.397316 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.397385 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.398570 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:45.398572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:45.398573 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:45.398579 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:45.398597 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:45.398602 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:45.398719 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:45.398843 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 00:35:45.398875 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:35:45.399133 18059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.393546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45421 (local address 127.7.252.1:54921)
0807 00:35:45.393755 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:45.393789 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:45.394455 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:45.394739 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:45.394743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:45.394753 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:45.395291 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.395296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.396021 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.396022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.396896 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.396899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.397428 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.397430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.397613 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.398396 (+ 783us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:45.398397 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:45.398433 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:45.398470 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:45.398746 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:45.398753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:45.398756 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:45.398823 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 00:35:45.398917 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260807 00:35:45.399847 18057 heartbeater.cc:347] Connected to a master server at 127.7.252.62:45421
I20260807 00:35:45.399986 18057 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:45.400193 18057 heartbeater.cc:511] Master 127.7.252.62:45421 requested a full tablet report, sending...
I20260807 00:35:45.400808 17866 ts_manager.cc:194] Registered new tserver with Master: 8b7ce11994274bebbb5285ec2746031e (127.7.252.1:42083)
I20260807 00:35:45.401808 17866 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.1:54921
W20260807 00:35:45.482292 18060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:45.482530 18060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:45.482553 18060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:45.483878 18060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:45.483938 18060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:45.483968 18060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:45.485477 18060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:45.485737 18060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:45.486030 18060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:45.491546 18066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.491694 18068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.491587 18065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.492059 18060 server_base.cc:1034] running on GCE node
I20260807 00:35:45.492327 18060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:45.492602 18060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:45.493818 18060 hybrid_clock.cc:648] HybridClock initialized: now 1786062945493814 us; error 43 us; skew 500 ppm
I20260807 00:35:45.495560 18060 webserver.cc:460] Webserver started at http://127.7.252.2:35161/ using document root <none> and password file <none>
I20260807 00:35:45.495858 18060 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:45.495939 18060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:45.496098 18060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:45.497371 18060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "96745a2b14c943b9b4be13440bddc5bb"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "18a01850fcdbfea0260259e3250aceda"
server_key_iv: "32719f9091347caef1c1ef67e3713a56"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.497771 18060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "96745a2b14c943b9b4be13440bddc5bb"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "18a01850fcdbfea0260259e3250aceda"
server_key_iv: "32719f9091347caef1c1ef67e3713a56"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.499472 18060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:45.500509 18074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.500818 18060 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:45.500944 18060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "96745a2b14c943b9b4be13440bddc5bb"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "18a01850fcdbfea0260259e3250aceda"
server_key_iv: "32719f9091347caef1c1ef67e3713a56"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.501034 18060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:45.522011 18060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:45.522511 18060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:45.522717 18060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:45.522989 18060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:45.523370 18060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:45.523430 18060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.523474 18060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:45.523547 18060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.530189 18060 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:38271
I20260807 00:35:45.530230 18191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:38271 every 8 connection(s)
I20260807 00:35:45.530594 18060 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:45.532752 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18060
I20260807 00:35:45.532858 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:45.533077 8176 external_mini_cluster.cc:1428] Setting key 328a327ad6f1d48a0c2873c90f20e4f0
I20260807 00:35:45.534551 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45421
--builtin_ntp_servers=127.7.252.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 00:35:45.537691 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.531451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:49921 (local address 127.7.252.62:45421)
0807 00:35:45.531503 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:45.531505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:45.531757 (+ 252us) server_negotiation.cc:407] Connection header received
0807 00:35:45.532540 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:45.532542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:45.532554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:45.532616 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:45.533670 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.534528 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.536107 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.536308 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.536407 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.537397 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:45.537399 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:45.537400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:45.537405 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:45.537422 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:45.537427 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:45.537497 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:45.537577 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 00:35:45.537607 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:35:45.537994 18194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.531420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45421 (local address 127.7.252.2:49921)
0807 00:35:45.531615 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:45.531656 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:45.532236 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:45.532741 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:45.532747 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:45.532758 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:45.533572 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.533579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.534644 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.534645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.536003 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.536007 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.536419 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.536421 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.536577 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.537208 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:45.537209 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:45.537257 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:45.537282 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:45.537499 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:45.537506 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:45.537510 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:45.537582 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 00:35:45.537766 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260807 00:35:45.538506 18192 heartbeater.cc:347] Connected to a master server at 127.7.252.62:45421
I20260807 00:35:45.538635 18192 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:45.538904 18192 heartbeater.cc:511] Master 127.7.252.62:45421 requested a full tablet report, sending...
I20260807 00:35:45.539381 17866 ts_manager.cc:194] Registered new tserver with Master: 96745a2b14c943b9b4be13440bddc5bb (127.7.252.2:38271)
I20260807 00:35:45.539793 17866 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.2:49921
W20260807 00:35:45.626157 18195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:45.626458 18195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:45.626503 18195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:45.627974 18195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:45.628068 18195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:45.628118 18195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:45.629755 18195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:45421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:45.630087 18195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:45.630465 18195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:45.636431 18200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.636370 18201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.636477 18195 server_base.cc:1034] running on GCE node
W20260807 00:35:45.636379 18203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.636937 18195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:45.637187 18195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:45.638350 18195 hybrid_clock.cc:648] HybridClock initialized: now 1786062945638336 us; error 30 us; skew 500 ppm
I20260807 00:35:45.640172 18195 webserver.cc:460] Webserver started at http://127.7.252.3:40967/ using document root <none> and password file <none>
I20260807 00:35:45.640589 18195 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:45.640656 18195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:45.640878 18195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:45.642099 18195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "5b04d05f9444407581a3c87fb171443e"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "9dc53e233d536e252bfc19014ce17ce9"
server_key_iv: "ab57d18f9488f5bdd08103db1e7fe2cd"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.642460 18195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "5b04d05f9444407581a3c87fb171443e"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "9dc53e233d536e252bfc19014ce17ce9"
server_key_iv: "ab57d18f9488f5bdd08103db1e7fe2cd"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.644106 18195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260807 00:35:45.645125 18210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.645563 18195 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:45.645690 18195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "5b04d05f9444407581a3c87fb171443e"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "9dc53e233d536e252bfc19014ce17ce9"
server_key_iv: "ab57d18f9488f5bdd08103db1e7fe2cd"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.645781 18195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:45.676532 18195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:45.676898 18195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:45.677065 18195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:45.677323 18195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:45.677671 18195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:45.677729 18195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.677771 18195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:45.677799 18195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.684317 18195 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:34541
I20260807 00:35:45.684365 18326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:34541 every 8 connection(s)
I20260807 00:35:45.684752 18195 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:45.690999 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.685789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:42039 (local address 127.7.252.62:45421)
0807 00:35:45.685843 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:45.685845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:45.686171 (+ 326us) server_negotiation.cc:407] Connection header received
0807 00:35:45.686843 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:45.686844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:45.686859 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:45.686903 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:45.687748 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.688285 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.689351 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.689564 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.689647 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.690676 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:45.690678 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:45.690678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:45.690686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:45.690704 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:45.690708 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:45.690760 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:45.690871 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 00:35:45.690906 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:35:45.691301 18329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.685779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45421 (local address 127.7.252.3:42039)
0807 00:35:45.686014 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:45.686054 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:45.686645 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:45.686996 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:45.687000 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:45.687009 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:45.687646 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.687652 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.688402 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.688403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.689243 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:45.689245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:45.689669 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:45.689670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:45.689822 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:45.690471 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:45.690471 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:45.690506 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:45.690533 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:45.690771 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:45.690777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:45.690781 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:45.690874 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 00:35:45.691024 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":95,"threads_started":1}
I20260807 00:35:45.691684 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18195
I20260807 00:35:45.691790 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:45.691773 18327 heartbeater.cc:347] Connected to a master server at 127.7.252.62:45421
I20260807 00:35:45.691900 18327 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:45.692083 8176 external_mini_cluster.cc:1428] Setting key b7ef14091779440f01d6332b66cb56c3
I20260807 00:35:45.692121 18327 heartbeater.cc:511] Master 127.7.252.62:45421 requested a full tablet report, sending...
I20260807 00:35:45.692536 17866 ts_manager.cc:194] Registered new tserver with Master: 5b04d05f9444407581a3c87fb171443e (127.7.252.3:34541)
I20260807 00:35:45.692974 17866 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.3:42039
I20260807 00:35:45.693940 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 00:35:45.696053 17906 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:45.695513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.7.252.62:45421)
0807 00:35:45.695562 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:45.695565 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:45.695664 (+ 99us) server_negotiation.cc:407] Connection header received
0807 00:35:45.695777 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:45.695778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:45.695788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:45.695840 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:45.695981 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46468: BlockingRecv error: recv got EOF from 127.0.0.1:46468 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:35:45.696296 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17926
I20260807 00:35:45.709930 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18060
I20260807 00:35:45.715813 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18195
I20260807 00:35:45.721210 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 17834
2026-08-07T00:35:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (670 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T00:35:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:45Z Disabled control of system clock
I20260807 00:35:45.753451 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:46073
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:35223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:46073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 00:35:45.844971 18339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:45.845247 18339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:45.845273 18339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:45.846532 18339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:45.846578 18339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:45.846591 18339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:45.846604 18339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:45.846616 18339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:45.848232 18339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:46073
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:46073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:45.848567 18339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:45.848875 18339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:45.854605 18345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:45.854575 18347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.854889 18339 server_base.cc:1034] running on GCE node
W20260807 00:35:45.854575 18344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:45.855309 18339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:45.855679 18339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:45.856882 18339 hybrid_clock.cc:648] HybridClock initialized: now 1786062945856870 us; error 61 us; skew 500 ppm
I20260807 00:35:45.858457 18339 webserver.cc:460] Webserver started at http://127.7.252.62:39639/ using document root <none> and password file <none>
I20260807 00:35:45.858853 18339 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:45.858942 18339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:45.859107 18339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:45.860258 18339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "d6f5a2a2f37b4d1b86820a0438716c97"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "0edb20538ad5940311cc155507079f57"
server_key_iv: "0e283516f69cec351bb0d247cc9d4201"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.860653 18339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "d6f5a2a2f37b4d1b86820a0438716c97"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "0edb20538ad5940311cc155507079f57"
server_key_iv: "0e283516f69cec351bb0d247cc9d4201"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.862071 18339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:45.863009 18354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:45.863210 18339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:45.863320 18339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "d6f5a2a2f37b4d1b86820a0438716c97"
format_stamp: "Formatted at 2026-08-07 00:35:45 on dist-test-slave-csg5"
server_key: "0edb20538ad5940311cc155507079f57"
server_key_iv: "0e283516f69cec351bb0d247cc9d4201"
server_key_version: "encryptionkey@0"
I20260807 00:35:45.863413 18339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:45.867172 18339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:45.867498 18339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:45.867656 18339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:45.872095 18339 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:46073
I20260807 00:35:45.872130 18407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:46073 every 8 connection(s)
I20260807 00:35:45.872501 18339 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:45.873263 18408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:45.876387 18408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97: Bootstrap starting.
I20260807 00:35:45.877048 18408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:45.877393 18408 log.cc:824] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:45.878252 18408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97: No bootstrap required, opened a new log
I20260807 00:35:45.879133 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18339
I20260807 00:35:45.879240 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:45.879438 8176 external_mini_cluster.cc:1428] Setting key 24f10a79a0ffbe293be63f7f2d2db57d
I20260807 00:35:45.880812 18408 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46073 } }
I20260807 00:35:45.880988 18408 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:45.881013 18408 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f5a2a2f37b4d1b86820a0438716c97, State: Initialized, Role: FOLLOWER
I20260807 00:35:45.881198 18408 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46073 } }
I20260807 00:35:45.881299 18408 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:45.881338 18408 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:45.881386 18408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:45.882225 18408 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46073 } }
I20260807 00:35:45.882371 18408 leader_election.cc:302] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6f5a2a2f37b4d1b86820a0438716c97; no voters:
I20260807 00:35:45.882581 18408 leader_election.cc:288] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:45.882586 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:45.880056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.7.252.62:46073)
0807 00:35:45.880298 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:45.880314 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:45.880348 (+ 34us) server_negotiation.cc:407] Connection header received
0807 00:35:45.880841 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:45.880851 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:45.880904 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:45.881113 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:45.881920 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:45.881925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:45.881925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:45.881931 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:45.881986 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:45.882007 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:45.882072 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:45.882199 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 00:35:45.882304 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":114,"threads_started":1}
I20260807 00:35:45.882900 18413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:45.882946 18408 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:45.883033 18413 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [term 1 LEADER]: Becoming Leader. State: Replica: d6f5a2a2f37b4d1b86820a0438716c97, State: Running, Role: LEADER
I20260807 00:35:45.883131 18413 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46073 } }
I20260807 00:35:45.883561 18414 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46073 } } }
I20260807 00:35:45.883788 18414 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:45.883767 18415 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6f5a2a2f37b4d1b86820a0438716c97. Latest consensus state: current_term: 1 leader_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f5a2a2f37b4d1b86820a0438716c97" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 46073 } } }
I20260807 00:35:45.884109 18415 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:45.884565 18423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:45.885130 18423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:45.887295 18423 catalog_manager.cc:1347] Generated new cluster ID: cb3829710d1c48ab8c5975e73c9b8fef
I20260807 00:35:45.887367 18423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:45.914726 18423 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:45.915046 18423 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:45.919147 18423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6f5a2a2f37b4d1b86820a0438716c97: Generated new TSK 0
I20260807 00:35:45.919413 18423 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:35:45.928329 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46073
--builtin_ntp_servers=127.7.252.20:35223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 00:35:46.024658 18432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:46.024915 18432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:46.024945 18432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:46.026419 18432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:46.026477 18432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:46.026530 18432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:46.028259 18432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:46.028573 18432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:46.028965 18432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:46.035014 18437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:46.035130 18440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:46.034997 18438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:46.035715 18432 server_base.cc:1034] running on GCE node
I20260807 00:35:46.035976 18432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:46.036221 18432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:46.037431 18432 hybrid_clock.cc:648] HybridClock initialized: now 1786062946037414 us; error 32 us; skew 500 ppm
I20260807 00:35:46.039469 18432 webserver.cc:460] Webserver started at http://127.7.252.1:36893/ using document root <none> and password file <none>
I20260807 00:35:46.039861 18432 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:46.039947 18432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:46.040109 18432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:46.041618 18432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "6c6c842d57bc4e02b836b64b9ac09fbb"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "57a2466a5755f4c194aa09361a7ee68c"
server_key_iv: "2e520a93fd2739fc1a28d4bd4ac752a2"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.042076 18432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "6c6c842d57bc4e02b836b64b9ac09fbb"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "57a2466a5755f4c194aa09361a7ee68c"
server_key_iv: "2e520a93fd2739fc1a28d4bd4ac752a2"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.043900 18432 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260807 00:35:46.044994 18446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.045562 18432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:46.045663 18432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "6c6c842d57bc4e02b836b64b9ac09fbb"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "57a2466a5755f4c194aa09361a7ee68c"
server_key_iv: "2e520a93fd2739fc1a28d4bd4ac752a2"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.045832 18432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:46.050495 18432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:46.050859 18432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:46.051021 18432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:46.051259 18432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:46.051630 18432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:46.051692 18432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.051738 18432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:46.051767 18432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.058769 18432 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:39797
I20260807 00:35:46.058810 18563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:39797 every 8 connection(s)
I20260807 00:35:46.059227 18432 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:46.062956 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:46.060140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:49801 (local address 127.7.252.62:46073)
0807 00:35:46.060219 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:46.060221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:46.060563 (+ 342us) server_negotiation.cc:407] Connection header received
0807 00:35:46.061043 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:46.061045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:46.061052 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:46.061132 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:46.062535 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:46.062537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:46.062537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:46.062542 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:46.062561 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:46.062566 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:46.062634 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:46.062871 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 00:35:46.062891 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:35:46.063103 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:46.060116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:46073 (local address 127.7.252.1:49801)
0807 00:35:46.060360 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:46.060408 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:46.060932 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:46.061191 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:46.061195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:46.061204 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:46.062360 (+ 1156us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:46.062360 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:46.062392 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:46.062424 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:46.062741 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:46.062750 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:46.062754 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:46.062849 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 00:35:46.062912 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":128,"threads_started":1}
I20260807 00:35:46.063683 18564 heartbeater.cc:347] Connected to a master server at 127.7.252.62:46073
I20260807 00:35:46.063776 18564 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:46.063971 18564 heartbeater.cc:511] Master 127.7.252.62:46073 requested a full tablet report, sending...
I20260807 00:35:46.064571 18371 ts_manager.cc:194] Registered new tserver with Master: 6c6c842d57bc4e02b836b64b9ac09fbb (127.7.252.1:39797)
I20260807 00:35:46.065420 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18432
I20260807 00:35:46.065518 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:46.065811 8176 external_mini_cluster.cc:1428] Setting key 7d886c407d7fdeebbe80231c3054cca6
I20260807 00:35:46.066958 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46073
--builtin_ntp_servers=127.7.252.20:35223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 00:35:46.153424 18567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:46.153656 18567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:46.153683 18567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:46.154984 18567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:46.155033 18567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:46.155061 18567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:46.156486 18567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:46.156754 18567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:46.157089 18567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:46.162565 18572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:46.162563 18575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:46.162853 18573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:46.162958 18567 server_base.cc:1034] running on GCE node
I20260807 00:35:46.163194 18567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:46.163493 18567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:46.164680 18567 hybrid_clock.cc:648] HybridClock initialized: now 1786062946164660 us; error 39 us; skew 500 ppm
I20260807 00:35:46.166366 18567 webserver.cc:460] Webserver started at http://127.7.252.2:39251/ using document root <none> and password file <none>
I20260807 00:35:46.166826 18567 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:46.166929 18567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:46.167098 18567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:46.168277 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "1a63f64da37d426c9287b54c29eb101d"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "f6a38e535e713e3b11dc05d17bd85b9d"
server_key_iv: "1149d8ab9207778b65ac091f9f12c057"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.168689 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "1a63f64da37d426c9287b54c29eb101d"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "f6a38e535e713e3b11dc05d17bd85b9d"
server_key_iv: "1149d8ab9207778b65ac091f9f12c057"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.170192 18567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:46.171242 18581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.171519 18567 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:35:46.171648 18567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "1a63f64da37d426c9287b54c29eb101d"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "f6a38e535e713e3b11dc05d17bd85b9d"
server_key_iv: "1149d8ab9207778b65ac091f9f12c057"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.171794 18567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:46.175940 18567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:46.176249 18567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:46.176406 18567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:46.176645 18567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:46.177008 18567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:46.177070 18567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.177115 18567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:46.177142 18567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.184151 18567 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:46201
I20260807 00:35:46.184204 18697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:46201 every 8 connection(s)
I20260807 00:35:46.184579 18567 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:46.188419 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:46.185505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:43495 (local address 127.7.252.62:46073)
0807 00:35:46.185558 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:46.185560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:46.185771 (+ 211us) server_negotiation.cc:407] Connection header received
0807 00:35:46.186300 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:46.186301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:46.186307 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:46.186376 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:46.188060 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:46.188061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:46.188062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:46.188067 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:46.188088 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:46.188094 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:46.188164 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:46.188265 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 00:35:46.188356 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:35:46.188614 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:46.185425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:46073 (local address 127.7.252.2:43495)
0807 00:35:46.185621 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:46.185673 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:46.186136 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:46.186514 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:46.186518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:46.186527 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:46.187832 (+ 1305us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:46.187833 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:46.187868 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:46.187903 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:46.188179 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:46.188184 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:46.188187 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:46.188256 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 00:35:46.188318 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260807 00:35:46.189390 18698 heartbeater.cc:347] Connected to a master server at 127.7.252.62:46073
I20260807 00:35:46.189491 18698 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:46.189689 18698 heartbeater.cc:511] Master 127.7.252.62:46073 requested a full tablet report, sending...
I20260807 00:35:46.190222 18371 ts_manager.cc:194] Registered new tserver with Master: 1a63f64da37d426c9287b54c29eb101d (127.7.252.2:46201)
I20260807 00:35:46.193519 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18567
I20260807 00:35:46.193626 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:46.193815 8176 external_mini_cluster.cc:1428] Setting key dc89a479745b14113bf62ffb51f271b7
I20260807 00:35:46.195062 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46073
--builtin_ntp_servers=127.7.252.20:35223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 00:35:46.285663 18701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:46.285974 18701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:46.286020 18701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:46.287520 18701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:46.287614 18701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:46.287672 18701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:46.289422 18701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:46.289760 18701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:46.290120 18701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:46.296525 18706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:46.296519 18709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:46.296665 18707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:46.296666 18701 server_base.cc:1034] running on GCE node
I20260807 00:35:46.297010 18701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:46.297232 18701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:46.298394 18701 hybrid_clock.cc:648] HybridClock initialized: now 1786062946298377 us; error 31 us; skew 500 ppm
I20260807 00:35:46.299964 18701 webserver.cc:460] Webserver started at http://127.7.252.3:34403/ using document root <none> and password file <none>
I20260807 00:35:46.300238 18701 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:46.300292 18701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:46.300439 18701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:46.301687 18701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "fbafb5cac3e24b6faaf778a820269550"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "80a797643ef25cdc67316a16c31e1b2f"
server_key_iv: "9929fc94428d8737442f236e6fe7e3f7"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.302076 18701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "fbafb5cac3e24b6faaf778a820269550"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "80a797643ef25cdc67316a16c31e1b2f"
server_key_iv: "9929fc94428d8737442f236e6fe7e3f7"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.303666 18701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:35:46.304754 18715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.305075 18701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:46.305238 18701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "fbafb5cac3e24b6faaf778a820269550"
format_stamp: "Formatted at 2026-08-07 00:35:46 on dist-test-slave-csg5"
server_key: "80a797643ef25cdc67316a16c31e1b2f"
server_key_iv: "9929fc94428d8737442f236e6fe7e3f7"
server_key_version: "encryptionkey@0"
I20260807 00:35:46.305320 18701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:46.309382 18701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:46.309698 18701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:46.309868 18701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:46.310112 18701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:46.310468 18701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:46.310539 18701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.310608 18701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:46.310643 18701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:46.317284 18701 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:36851
I20260807 00:35:46.317427 18833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:36851 every 8 connection(s)
I20260807 00:35:46.317780 18701 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:46.321517 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:46.318724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:37793 (local address 127.7.252.62:46073)
0807 00:35:46.318795 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:46.318798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:46.319081 (+ 283us) server_negotiation.cc:407] Connection header received
0807 00:35:46.319695 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:46.319697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:46.319705 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:46.319782 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:46.321164 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:46.321167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:46.321167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:35:46.321173 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:46.321192 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:35:46.321197 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:46.321265 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:46.321387 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 00:35:46.321408 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 00:35:46.321712 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:46.318700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:46073 (local address 127.7.252.3:37793)
0807 00:35:46.318944 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:46.318983 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:46.319562 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:46.319875 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:46.319879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:46.319887 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:46.320981 (+ 1094us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:35:46.320982 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:46.321014 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:35:46.321044 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:46.321271 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:46.321277 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:46.321280 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:35:46.321382 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 00:35:46.321454 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":95,"threads_started":1}
I20260807 00:35:46.321785 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18701
I20260807 00:35:46.321925 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:46.322155 8176 external_mini_cluster.cc:1428] Setting key aa8dbd4e14d876f64d1b403ce9343105
I20260807 00:35:46.322306 18834 heartbeater.cc:347] Connected to a master server at 127.7.252.62:46073
I20260807 00:35:46.322418 18834 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:46.322592 18834 heartbeater.cc:511] Master 127.7.252.62:46073 requested a full tablet report, sending...
I20260807 00:35:46.323056 18370 ts_manager.cc:194] Registered new tserver with Master: fbafb5cac3e24b6faaf778a820269550 (127.7.252.3:36851)
I20260807 00:35:46.334645 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 00:35:46.337077 18412 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:35:46.336317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51280 (local address 127.7.252.62:46073)
0807 00:35:46.336391 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:46.336394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:46.336554 (+ 160us) server_negotiation.cc:407] Connection header received
0807 00:35:46.336602 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:46.336603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:46.336608 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:46.336663 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:46.336961 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51280: BlockingRecv error: recv got EOF from 127.0.0.1:51280 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 00:35:46.337126 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18432
I20260807 00:35:46.343760 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18567
I20260807 00:35:46.351549 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18701
I20260807 00:35:46.358584 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18339
2026-08-07T00:35:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (638 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:46 dist-test-slave-csg5 krb5kdc[18844](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:46 dist-test-slave-csg5 krb5kdc[18844](info): set up 2 sockets
Aug 07 00:35:46 dist-test-slave-csg5 krb5kdc[18844](info): commencing operation
krb5kdc: starting...
W20260807 00:35:47.485208 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:47 dist-test-slave-csg5 krb5kdc[18844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:35:47.628072 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:37883
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:37883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:47.715116 18858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:47.715410 18858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:47.715451 18858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:47.716691 18858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:35:47.716770 18858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:47.716795 18858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:47.716818 18858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:35:47.716846 18858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:35:47.718464 18858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:37883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:37883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:47.718798 18858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:47.719064 18858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:47.725063 18864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:47.725085 18866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:47.725085 18863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:47.725126 18858 server_base.cc:1034] running on GCE node
I20260807 00:35:47.725734 18858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:47.726158 18858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:47.727358 18858 hybrid_clock.cc:648] HybridClock initialized: now 1786062947727342 us; error 38 us; skew 500 ppm
Aug 07 00:35:47 dist-test-slave-csg5 krb5kdc[18844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062947, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:47.730368 18858 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:35:47.730999 18858 webserver.cc:460] Webserver started at http://127.7.252.62:44993/ using document root <none> and password file <none>
I20260807 00:35:47.731249 18858 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:47.731328 18858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:47.731487 18858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:47.732697 18858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "637c1fbe9b6a418d924b7925e6f5dc23"
format_stamp: "Formatted at 2026-08-07 00:35:47 on dist-test-slave-csg5"
server_key: "119b39af8d46d95ce5042b04984f199e"
server_key_iv: "04fb1fdd6cf6aaff49a35e56e6363d6c"
server_key_version: "encryptionkey@0"
I20260807 00:35:47.733124 18858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "637c1fbe9b6a418d924b7925e6f5dc23"
format_stamp: "Formatted at 2026-08-07 00:35:47 on dist-test-slave-csg5"
server_key: "119b39af8d46d95ce5042b04984f199e"
server_key_iv: "04fb1fdd6cf6aaff49a35e56e6363d6c"
server_key_version: "encryptionkey@0"
I20260807 00:35:47.734642 18858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:47.735769 18873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:47.736037 18858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:47.736179 18858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "637c1fbe9b6a418d924b7925e6f5dc23"
format_stamp: "Formatted at 2026-08-07 00:35:47 on dist-test-slave-csg5"
server_key: "119b39af8d46d95ce5042b04984f199e"
server_key_iv: "04fb1fdd6cf6aaff49a35e56e6363d6c"
server_key_version: "encryptionkey@0"
I20260807 00:35:47.736271 18858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:47.744159 18858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:47.747084 18858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:47.747468 18858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:47.752774 18858 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:37883
I20260807 00:35:47.752822 18927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:37883 every 8 connection(s)
I20260807 00:35:47.753250 18858 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:35:47.754405 18928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:47.754637 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18858
I20260807 00:35:47.754797 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:35:47.755028 8176 external_mini_cluster.cc:1428] Setting key 3bb11385a76cf376cf2e012eb26533b4
I20260807 00:35:47.757194 18928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23: Bootstrap starting.
I20260807 00:35:47.757831 18928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:47.758167 18928 log.cc:824] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:47.759055 18928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23: No bootstrap required, opened a new log
I20260807 00:35:47.761731 18928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37883 } }
I20260807 00:35:47.761942 18928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:47.761972 18928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 637c1fbe9b6a418d924b7925e6f5dc23, State: Initialized, Role: FOLLOWER
I20260807 00:35:47.762118 18928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37883 } }
I20260807 00:35:47.762208 18928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:35:47.762246 18928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:35:47.762320 18928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 00:35:47 dist-test-slave-csg5 krb5kdc[18844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:47.763055 18928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37883 } }
I20260807 00:35:47.763195 18928 leader_election.cc:302] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 637c1fbe9b6a418d924b7925e6f5dc23; no voters:
I20260807 00:35:47.763437 18928 leader_election.cc:288] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:35:47.763509 18933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:47.763700 18933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [term 1 LEADER]: Becoming Leader. State: Replica: 637c1fbe9b6a418d924b7925e6f5dc23, State: Running, Role: LEADER
I20260807 00:35:47.763741 18928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:35:47.763806 18933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37883 } }
I20260807 00:35:47.764253 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 637c1fbe9b6a418d924b7925e6f5dc23. Latest consensus state: current_term: 1 leader_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37883 } } }
I20260807 00:35:47.764338 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:47.764328 18934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637c1fbe9b6a418d924b7925e6f5dc23" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37883 } } }
I20260807 00:35:47.764468 18934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23 [sys.catalog]: This master's current role is: LEADER
I20260807 00:35:47.764643 18941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:35:47.765390 18941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:35:47.767586 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:47.755737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.7.252.62:37883)
0807 00:35:47.755938 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:47.755945 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:47.755972 (+ 27us) server_negotiation.cc:407] Connection header received
0807 00:35:47.756390 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:47.756396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:47.756445 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:47.756605 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:47.757284 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:47.758370 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:47.759453 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:47.759899 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:47.759991 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:47.763168 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:47.763173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:47.763173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:47.763187 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:47.765651 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:47.766144 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:47.766148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:47.766148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:47.766233 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:47.766469 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:47.766471 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:47.766471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:47.766821 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:47.766964 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:47.767160 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 00:35:47.767332 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":85,"threads_started":1}
I20260807 00:35:47.768095 18941 catalog_manager.cc:1347] Generated new cluster ID: 72c67cd7d52e48f3827b29a07d8b5e78
I20260807 00:35:47.768150 18941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:35:47.782740 18941 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:35:47.783449 18941 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:35:47.787815 18941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23: Generated new TSK 0
I20260807 00:35:47.788054 18941 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:35:47.823837 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37883
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:47.920107 18954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:47.920403 18954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:47.920454 18954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:47.921878 18954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:47.921965 18954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:47.922020 18954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:35:47.923805 18954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:47.924152 18954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:47.924450 18954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:47.930795 18960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:47.931056 18954 server_base.cc:1034] running on GCE node
W20260807 00:35:47.930986 18963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:47.931200 18959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:47.931447 18954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:47.931756 18954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:47.932974 18954 hybrid_clock.cc:648] HybridClock initialized: now 1786062947932934 us; error 63 us; skew 500 ppm
Aug 07 00:35:47 dist-test-slave-csg5 krb5kdc[18844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062947, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:47.936376 18954 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:35:47.936949 18954 webserver.cc:460] Webserver started at http://127.7.252.1:33931/ using document root <none> and password file <none>
I20260807 00:35:47.937217 18954 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:47.937309 18954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:47.937482 18954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:47.938856 18954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "2e3b2cd2c5a046cdb639c57a386d45c6"
format_stamp: "Formatted at 2026-08-07 00:35:47 on dist-test-slave-csg5"
server_key: "dec839a9bb1afc3bc0cb438072112119"
server_key_iv: "10b1043fa28df3cce3e02d32cbaf12f8"
server_key_version: "encryptionkey@0"
I20260807 00:35:47.939298 18954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "2e3b2cd2c5a046cdb639c57a386d45c6"
format_stamp: "Formatted at 2026-08-07 00:35:47 on dist-test-slave-csg5"
server_key: "dec839a9bb1afc3bc0cb438072112119"
server_key_iv: "10b1043fa28df3cce3e02d32cbaf12f8"
server_key_version: "encryptionkey@0"
I20260807 00:35:47.941146 18954 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 00:35:47.942235 18970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:47.942498 18954 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:47.942629 18954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "2e3b2cd2c5a046cdb639c57a386d45c6"
format_stamp: "Formatted at 2026-08-07 00:35:47 on dist-test-slave-csg5"
server_key: "dec839a9bb1afc3bc0cb438072112119"
server_key_iv: "10b1043fa28df3cce3e02d32cbaf12f8"
server_key_version: "encryptionkey@0"
I20260807 00:35:47.942759 18954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:47.955564 18954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:47.958240 18954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:47.958464 18954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:47.959115 18954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:47.959743 18954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:47.959856 18954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:47.959925 18954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:47.959956 18954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:47.966727 18954 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:45273
I20260807 00:35:47.966789 19087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:45273 every 8 connection(s)
I20260807 00:35:47.967167 18954 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:35:47.971267 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 18954
I20260807 00:35:47.971499 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:35:47.971731 8176 external_mini_cluster.cc:1428] Setting key f4e213839130d611eae169aa583b0b33
Aug 07 00:35:47 dist-test-slave-csg5 krb5kdc[18844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062947, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:47.980060 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:47.968182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:40415 (local address 127.7.252.62:37883)
0807 00:35:47.968245 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:47.968247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:47.968459 (+ 212us) server_negotiation.cc:407] Connection header received
0807 00:35:47.968959 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:47.968961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:47.968974 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:47.969053 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:47.970108 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:47.970876 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:47.972406 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:47.972716 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:47.972817 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:47.976433 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:47.976435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:47.976435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:47.976446 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:47.978303 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:47.978913 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:47.978914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:47.978915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:47.978988 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:47.979284 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:47.979286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:47.979286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:47.979426 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:47.979507 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:47.979853 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 00:35:47.979963 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 00:35:47.980266 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:47.968071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:37883 (local address 127.7.252.1:40415)
0807 00:35:47.968255 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:47.968301 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:47.968832 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:47.969112 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:47.969116 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:47.969740 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:47.969971 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:47.969976 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:47.970989 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:47.970990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:47.972238 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:47.972241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:47.972835 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:47.972837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:47.973007 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:47.973677 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:47.973702 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:47.976193 (+ 2491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:47.978431 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:47.978451 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:47.978454 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:47.978823 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:47.979069 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:47.979070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:47.979071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:47.979210 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:47.979509 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:47.979518 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:47.979685 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 00:35:47.979812 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 00:35:47.980002 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
I20260807 00:35:47.980953 19088 heartbeater.cc:347] Connected to a master server at 127.7.252.62:37883
I20260807 00:35:47.981099 19088 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:47.981361 19088 heartbeater.cc:511] Master 127.7.252.62:37883 requested a full tablet report, sending...
I20260807 00:35:47.982125 18890 ts_manager.cc:194] Registered new tserver with Master: 2e3b2cd2c5a046cdb639c57a386d45c6 (127.7.252.1:45273)
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:35:47.983335 18890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:40415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:35:48.008018 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37883
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:48.095264 19094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:48.095490 19094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:48.095517 19094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:48.096760 19094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:48.096813 19094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:48.096843 19094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:35:48.098521 19094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:48.098860 19094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:48.099336 19094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:48.105163 19099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:48.105527 19100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:48.105605 19094 server_base.cc:1034] running on GCE node
W20260807 00:35:48.105656 19102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:48.105927 19094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:48.106226 19094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:48.107431 19094 hybrid_clock.cc:648] HybridClock initialized: now 1786062948107385 us; error 65 us; skew 500 ppm
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[18844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062948, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:48.110329 19094 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:35:48.110934 19094 webserver.cc:460] Webserver started at http://127.7.252.2:40751/ using document root <none> and password file <none>
I20260807 00:35:48.111208 19094 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:48.111258 19094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:48.111403 19094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:48.112521 19094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "30c0229ccb0145059a84132c8cc353aa"
format_stamp: "Formatted at 2026-08-07 00:35:48 on dist-test-slave-csg5"
server_key: "8c8a054642b688c1557d97c7a9a5be81"
server_key_iv: "a7c82db7566a0a154f70a2a7c56a79a5"
server_key_version: "encryptionkey@0"
I20260807 00:35:48.112895 19094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "30c0229ccb0145059a84132c8cc353aa"
format_stamp: "Formatted at 2026-08-07 00:35:48 on dist-test-slave-csg5"
server_key: "8c8a054642b688c1557d97c7a9a5be81"
server_key_iv: "a7c82db7566a0a154f70a2a7c56a79a5"
server_key_version: "encryptionkey@0"
I20260807 00:35:48.114420 19094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:35:48.115502 19109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:48.115849 19094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:48.115938 19094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "30c0229ccb0145059a84132c8cc353aa"
format_stamp: "Formatted at 2026-08-07 00:35:48 on dist-test-slave-csg5"
server_key: "8c8a054642b688c1557d97c7a9a5be81"
server_key_iv: "a7c82db7566a0a154f70a2a7c56a79a5"
server_key_version: "encryptionkey@0"
I20260807 00:35:48.116057 19094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:48.129727 19094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:48.132615 19094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:48.132844 19094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:48.133237 19094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:48.133653 19094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:48.133699 19094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:48.133812 19094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:48.133827 19094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:48.141904 19094 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:45793
I20260807 00:35:48.142067 19225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:45793 every 8 connection(s)
I20260807 00:35:48.142424 19094 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:35:48.145192 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 19094
I20260807 00:35:48.145381 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:35:48.145610 8176 external_mini_cluster.cc:1428] Setting key a6a02f6c689ca2eb7f57bded838f94ab
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[18844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062948, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:48.153584 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.143440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:37787 (local address 127.7.252.62:37883)
0807 00:35:48.143522 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.143529 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.143733 (+ 204us) server_negotiation.cc:407] Connection header received
0807 00:35:48.144291 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.144292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.144304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.144432 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:48.145650 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.146384 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.147597 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.147822 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.147931 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.150360 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:48.150366 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:48.150366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:48.150374 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:48.151951 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:48.152480 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:48.152482 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:48.152482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:48.152545 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:48.152845 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:48.152846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:48.152846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:48.152976 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:48.153053 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.153379 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.153485 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:35:48.153782 19228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.143381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:37883 (local address 127.7.252.2:37787)
0807 00:35:48.143570 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.143620 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.144162 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.144538 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.144542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.145209 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:48.145519 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.145526 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.146471 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.146471 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.147486 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.147489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.147943 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.147944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.148091 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.148719 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:48.148730 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:48.150232 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:48.152094 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:48.152105 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:48.152108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:48.152377 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:48.152629 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:48.152629 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:48.152630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:48.152754 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:48.153055 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:48.153063 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:48.153233 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.153347 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.153529 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:35:48.154650 19226 heartbeater.cc:347] Connected to a master server at 127.7.252.62:37883
I20260807 00:35:48.154807 19226 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:48.155017 19226 heartbeater.cc:511] Master 127.7.252.62:37883 requested a full tablet report, sending...
I20260807 00:35:48.155577 18890 ts_manager.cc:194] Registered new tserver with Master: 30c0229ccb0145059a84132c8cc353aa (127.7.252.2:45793)
I20260807 00:35:48.156028 18890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:37787
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:35:48.179680 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37883
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:35:48.268702 19231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:35:48.268947 19231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:35:48.268977 19231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:35:48.270365 19231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:35:48.270421 19231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:35:48.270452 19231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:35:48.272255 19231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:35:48.272599 19231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:35:48.272894 19231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:35:48.279029 19241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:48.279004 19239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:35:48.279009 19238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:35:48.279507 19231 server_base.cc:1034] running on GCE node
I20260807 00:35:48.279783 19231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:35:48.280114 19231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:35:48.281311 19231 hybrid_clock.cc:648] HybridClock initialized: now 1786062948281298 us; error 62 us; skew 500 ppm
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[18844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062948, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:35:48.284617 19231 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:35:48.285250 19231 webserver.cc:460] Webserver started at http://127.7.252.3:38841/ using document root <none> and password file <none>
I20260807 00:35:48.285562 19231 fs_manager.cc:359] Metadata directory not provided
I20260807 00:35:48.285617 19231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:35:48.285773 19231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:35:48.287101 19231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "67b9da1aeed948068ad9640912040c89"
format_stamp: "Formatted at 2026-08-07 00:35:48 on dist-test-slave-csg5"
server_key: "3f6da6c310e152fa9e0679d062a193d5"
server_key_iv: "d56d7e2a1b3aae24e2758c7217a5b6c1"
server_key_version: "encryptionkey@0"
I20260807 00:35:48.287575 19231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "67b9da1aeed948068ad9640912040c89"
format_stamp: "Formatted at 2026-08-07 00:35:48 on dist-test-slave-csg5"
server_key: "3f6da6c310e152fa9e0679d062a193d5"
server_key_iv: "d56d7e2a1b3aae24e2758c7217a5b6c1"
server_key_version: "encryptionkey@0"
I20260807 00:35:48.289331 19231 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:35:48.290284 19248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:48.290607 19231 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:35:48.290750 19231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "67b9da1aeed948068ad9640912040c89"
format_stamp: "Formatted at 2026-08-07 00:35:48 on dist-test-slave-csg5"
server_key: "3f6da6c310e152fa9e0679d062a193d5"
server_key_iv: "d56d7e2a1b3aae24e2758c7217a5b6c1"
server_key_version: "encryptionkey@0"
I20260807 00:35:48.290840 19231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:35:48.301815 19231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:35:48.304710 19231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:35:48.304915 19231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:35:48.305226 19231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:35:48.305598 19231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:35:48.305635 19231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:48.305661 19231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:35:48.305716 19231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:35:48.313457 19231 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:45129
I20260807 00:35:48.313542 19365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:45129 every 8 connection(s)
I20260807 00:35:48.313923 19231 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:35:48.316555 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 19231
I20260807 00:35:48.316685 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:35:48.316937 8176 external_mini_cluster.cc:1428] Setting key 15478ce93acb78d0b42c53fa488bb9ff
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[18844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062948, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:35:48.324607 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.315035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:42045 (local address 127.7.252.62:37883)
0807 00:35:48.315123 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.315125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.315380 (+ 255us) server_negotiation.cc:407] Connection header received
0807 00:35:48.315932 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.315933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.315946 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.316015 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:48.317148 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.317823 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.318911 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.319125 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.319222 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.321517 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:48.321519 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:48.321520 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:48.321528 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:48.323042 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:48.323509 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:48.323510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:48.323510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:48.323577 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:48.323857 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:48.323858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:48.323859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:48.323995 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:48.324103 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.324412 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.324506 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 00:35:48.324851 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.314951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:37883 (local address 127.7.252.3:42045)
0807 00:35:48.315206 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.315245 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.315799 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.316071 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.316074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.316786 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:35:48.317057 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.317063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.317903 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.317905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.318809 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.318811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.319232 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.319233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.319366 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.319955 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:35:48.319966 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:35:48.321412 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:35:48.323138 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:48.323146 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:48.323148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:48.323402 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:48.323656 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:35:48.323657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:35:48.323657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:35:48.323774 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:35:48.324099 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:35:48.324107 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:35:48.324259 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.324379 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.324561 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":115,"threads_started":1}
I20260807 00:35:48.325580 19366 heartbeater.cc:347] Connected to a master server at 127.7.252.62:37883
I20260807 00:35:48.325683 19366 heartbeater.cc:464] Registering TS with master...
I20260807 00:35:48.325892 19366 heartbeater.cc:511] Master 127.7.252.62:37883 requested a full tablet report, sending...
I20260807 00:35:48.326421 18890 ts_manager.cc:194] Registered new tserver with Master: 67b9da1aeed948068ad9640912040c89 (127.7.252.3:45129)
I20260807 00:35:48.326972 18890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:42045
I20260807 00:35:48.329097 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:35:48.336936 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.330416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59168 (local address 127.7.252.62:37883)
0807 00:35:48.330500 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.330502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.330578 (+ 76us) server_negotiation.cc:407] Connection header received
0807 00:35:48.330624 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.330625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.330634 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.330746 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:35:48.331334 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.331857 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.332759 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.332942 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.332995 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.334332 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:35:48.334333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:35:48.334334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:35:48.334339 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:35:48.335730 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:48.336119 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:48.336120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:48.336120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:48.336170 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:35:48.336360 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:35:48.336361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:35:48.336361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:35:48.336536 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:35:48.336614 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.336775 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.336836 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 00:35:48.338847 18890 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:35:48.340781 18890 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:35:48.348392 19379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.343498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:45793 (local address 127.0.0.1:38740)
0807 00:35:48.344003 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.344015 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.344116 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.344426 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.344430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.344433 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:48.344514 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.344516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.345481 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.345483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.347003 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.347008 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.348034 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.348035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.348139 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.348156 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.348225 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.348286 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":82,"thread_start_us":88,"threads_started":1}
I20260807 00:35:48.348763 19378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.343761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45273 (local address 127.0.0.1:56296)
0807 00:35:48.344108 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.344119 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.344175 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.344570 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.344572 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.344574 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:48.344617 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.344619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.345597 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.345599 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.346988 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.346990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.347968 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.347969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.348565 (+ 596us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.348570 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.348628 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.348676 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":77,"threads_started":1}
I20260807 00:35:48.349030 19383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.343889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56296 (local address 127.7.252.1:45273)
0807 00:35:48.344085 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.344089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.344247 (+ 158us) server_negotiation.cc:407] Connection header received
0807 00:35:48.344302 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.344304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.344323 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.344448 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:48.344683 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.345475 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.347088 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.347874 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.347947 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.348017 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.348881 (+ 864us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.348939 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":81,"threads_started":1}
I20260807 00:35:48.349756 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.343498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:45129 (local address 127.0.0.1:54940)
0807 00:35:48.343943 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.343990 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.344074 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.345506 (+ 1432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.345507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.345509 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:48.345561 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.345562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.346949 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.346950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.347874 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.347877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.349505 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.349507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.349579 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.349584 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.349639 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.349681 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":77,"threads_started":1}
I20260807 00:35:48.350028 19380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.343652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54940 (local address 127.7.252.3:45129)
0807 00:35:48.343928 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.343934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.344069 (+ 135us) server_negotiation.cc:407] Connection header received
0807 00:35:48.344497 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.344501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.344517 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.344631 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:48.345642 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.346839 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.348011 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.349303 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.349383 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.349447 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.349873 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.349928 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":146,"threads_started":1}
I20260807 00:35:48.349957 19021 tablet_service.cc:1467] Processing CreateTablet for tablet 832ea198a1fb451c93d068cb32d85e92 (DEFAULT_TABLE table=test-table [id=4baf6a5d30b5493ead71767b047a19ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:48.350414 19021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 832ea198a1fb451c93d068cb32d85e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:48.351222 19381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.343673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38740 (local address 127.7.252.2:45793)
0807 00:35:48.343928 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.343934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.344083 (+ 149us) server_negotiation.cc:407] Connection header received
0807 00:35:48.344270 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.344273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.344293 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.344377 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:48.344624 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.345370 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.347131 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.347863 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.350904 (+ 3041us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.351014 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.351048 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.351110 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":128,"threads_started":1}
I20260807 00:35:48.351938 19158 tablet_service.cc:1467] Processing CreateTablet for tablet 832ea198a1fb451c93d068cb32d85e92 (DEFAULT_TABLE table=test-table [id=4baf6a5d30b5493ead71767b047a19ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:48.352319 19158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 832ea198a1fb451c93d068cb32d85e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:48.353152 19298 tablet_service.cc:1467] Processing CreateTablet for tablet 832ea198a1fb451c93d068cb32d85e92 (DEFAULT_TABLE table=test-table [id=4baf6a5d30b5493ead71767b047a19ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:35:48.353502 19298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 832ea198a1fb451c93d068cb32d85e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:35:48.354956 19384 tablet_bootstrap.cc:492] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6: Bootstrap starting.
I20260807 00:35:48.355932 19384 tablet_bootstrap.cc:654] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:48.356129 19385 tablet_bootstrap.cc:492] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Bootstrap starting.
I20260807 00:35:48.356761 19384 log.cc:824] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:48.356916 19385 tablet_bootstrap.cc:654] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:48.357573 19385 log.cc:824] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:48.357951 19387 tablet_bootstrap.cc:492] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Bootstrap starting.
I20260807 00:35:48.357986 19384 tablet_bootstrap.cc:492] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6: No bootstrap required, opened a new log
I20260807 00:35:48.358166 19384 ts_tablet_manager.cc:1397] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:35:48.358372 19385 tablet_bootstrap.cc:492] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: No bootstrap required, opened a new log
I20260807 00:35:48.358444 19385 ts_tablet_manager.cc:1397] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:35:48.358649 19387 tablet_bootstrap.cc:654] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Neither blocks nor log segments found. Creating new log.
I20260807 00:35:48.359181 19387 log.cc:824] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Log is configured to *not* fsync() on all Append() calls
I20260807 00:35:48.359894 19387 tablet_bootstrap.cc:492] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: No bootstrap required, opened a new log
I20260807 00:35:48.359982 19387 ts_tablet_manager.cc:1397] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:35:48.360495 19384 raft_consensus.cc:348] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.360710 19384 raft_consensus.cc:374] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:48.360623 19385 raft_consensus.cc:348] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.360752 19384 raft_consensus.cc:729] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b2cd2c5a046cdb639c57a386d45c6, State: Initialized, Role: FOLLOWER
I20260807 00:35:48.360787 19385 raft_consensus.cc:374] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:48.360826 19385 raft_consensus.cc:729] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30c0229ccb0145059a84132c8cc353aa, State: Initialized, Role: FOLLOWER
I20260807 00:35:48.360911 19384 consensus_queue.cc:260] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.360935 19385 consensus_queue.cc:260] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.361238 19385 ts_tablet_manager.cc:1428] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:48.361238 19384 ts_tablet_manager.cc:1428] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:35:48.361264 19226 heartbeater.cc:503] Master 127.7.252.62:37883 was elected leader, sending a full tablet report...
I20260807 00:35:48.361584 19088 heartbeater.cc:503] Master 127.7.252.62:37883 was elected leader, sending a full tablet report...
I20260807 00:35:48.361747 19387 raft_consensus.cc:348] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.361918 19387 raft_consensus.cc:374] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:35:48.361963 19387 raft_consensus.cc:729] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b9da1aeed948068ad9640912040c89, State: Initialized, Role: FOLLOWER
I20260807 00:35:48.362462 19387 consensus_queue.cc:260] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.362818 19366 heartbeater.cc:503] Master 127.7.252.62:37883 was elected leader, sending a full tablet report...
I20260807 00:35:48.362799 19387 ts_tablet_manager.cc:1428] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:35:48.364157 19390 raft_consensus.cc:482] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:35:48.364230 19390 raft_consensus.cc:504] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.364632 19390 leader_election.cc:288] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67b9da1aeed948068ad9640912040c89 (127.7.252.3:45129), 2e3b2cd2c5a046cdb639c57a386d45c6 (127.7.252.1:45273)
I20260807 00:35:48.368014 19228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.364787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45273 (local address 127.7.252.2:56213)
0807 00:35:48.364828 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.364841 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.364881 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.365166 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.365167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.365169 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:48.365233 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.365235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.365972 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.365973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.366887 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.366889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.367802 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.367803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.367868 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.367872 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.367926 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.367959 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":3}
I20260807 00:35:48.368069 19383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.364997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:56213 (local address 127.7.252.1:45273)
0807 00:35:48.365042 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.365044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.365053 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:35:48.365078 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.365080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.365091 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.365160 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:48.365325 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.365880 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.367044 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.367721 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.367796 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.367808 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.367956 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.367998 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:35:48.368369 19042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "832ea198a1fb451c93d068cb32d85e92" candidate_uuid: "30c0229ccb0145059a84132c8cc353aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" is_pre_election: true
I20260807 00:35:48.368526 19042 raft_consensus.cc:2454] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30c0229ccb0145059a84132c8cc353aa in term 0.
I20260807 00:35:48.368753 19380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.365081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:37351 (local address 127.7.252.3:45129)
0807 00:35:48.365125 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.365128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.365136 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:35:48.365180 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.365181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.365192 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.365227 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:35:48.365464 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.366056 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.367571 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.368239 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.368281 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.368289 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.368636 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.368685 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:35:48.368750 19111 leader_election.cc:302] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b2cd2c5a046cdb639c57a386d45c6, 30c0229ccb0145059a84132c8cc353aa; no voters:
I20260807 00:35:48.368762 19393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.364834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:45129 (local address 127.7.252.2:37351)
0807 00:35:48.365022 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.365034 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:35:48.365101 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:35:48.365311 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:35:48.365312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:35:48.365313 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:35:48.365387 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.365388 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.366159 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.366160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.367455 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:35:48.367458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.368448 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.368448 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:35:48.368552 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.368556 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:35:48.368610 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 00:35:48.368658 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":131,"threads_started":1}
I20260807 00:35:48.368911 19390 raft_consensus.cc:2781] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:35:48.368996 19390 raft_consensus.cc:482] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:35:48.369033 19390 raft_consensus.cc:3037] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:48.369164 19318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "832ea198a1fb451c93d068cb32d85e92" candidate_uuid: "30c0229ccb0145059a84132c8cc353aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b9da1aeed948068ad9640912040c89" is_pre_election: true
I20260807 00:35:48.369293 19318 raft_consensus.cc:2454] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30c0229ccb0145059a84132c8cc353aa in term 0.
I20260807 00:35:48.369894 19390 raft_consensus.cc:504] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.370110 19390 leader_election.cc:288] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [CANDIDATE]: Term 1 election: Requested vote from peers 67b9da1aeed948068ad9640912040c89 (127.7.252.3:45129), 2e3b2cd2c5a046cdb639c57a386d45c6 (127.7.252.1:45273)
I20260807 00:35:48.370194 19318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "832ea198a1fb451c93d068cb32d85e92" candidate_uuid: "30c0229ccb0145059a84132c8cc353aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b9da1aeed948068ad9640912040c89"
I20260807 00:35:48.370288 19318 raft_consensus.cc:3037] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:48.370301 19042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "832ea198a1fb451c93d068cb32d85e92" candidate_uuid: "30c0229ccb0145059a84132c8cc353aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6"
I20260807 00:35:48.370378 19042 raft_consensus.cc:3037] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:35:48.371381 19318 raft_consensus.cc:2454] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30c0229ccb0145059a84132c8cc353aa in term 1.
I20260807 00:35:48.371379 19042 raft_consensus.cc:2454] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30c0229ccb0145059a84132c8cc353aa in term 1.
I20260807 00:35:48.371589 19113 leader_election.cc:302] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30c0229ccb0145059a84132c8cc353aa, 67b9da1aeed948068ad9640912040c89; no voters:
I20260807 00:35:48.371776 19390 raft_consensus.cc:2781] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:35:48.371965 19390 raft_consensus.cc:686] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 1 LEADER]: Becoming Leader. State: Replica: 30c0229ccb0145059a84132c8cc353aa, State: Running, Role: LEADER
I20260807 00:35:48.372112 19390 consensus_queue.cc:237] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } }
I20260807 00:35:48.373135 18889 catalog_manager.cc:5495] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 30c0229ccb0145059a84132c8cc353aa (127.7.252.2). New cstate: current_term: 1 leader_uuid: "30c0229ccb0145059a84132c8cc353aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30c0229ccb0145059a84132c8cc353aa" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 45793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 } health_report { overall_health: UNKNOWN } } }
I20260807 00:35:48.386858 19381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.383948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38750 (local address 127.7.252.2:45793)
0807 00:35:48.384045 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 00:35:48.384047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:35:48.384057 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:35:48.384095 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:35:48.384096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:35:48.384118 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:35:48.384276 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:35:48.384544 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.385041 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.385865 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:35:48.386100 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:35:48.386182 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:35:48.386346 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:35:48.386465 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:35:48.386537 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 00:35:48.386579 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 00:35:48.386601 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 00:35:48.389139 19042 raft_consensus.cc:1261] T 832ea198a1fb451c93d068cb32d85e92 P 2e3b2cd2c5a046cdb639c57a386d45c6 [term 1 FOLLOWER]: Refusing update from remote peer 30c0229ccb0145059a84132c8cc353aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:48.389176 19318 raft_consensus.cc:1261] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 1 FOLLOWER]: Refusing update from remote peer 30c0229ccb0145059a84132c8cc353aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:35:48.389628 19394 consensus_queue.cc:1035] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3b2cd2c5a046cdb639c57a386d45c6" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:48.389850 19390 consensus_queue.cc:1035] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67b9da1aeed948068ad9640912040c89" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:35:48.393007 19397 mvcc.cc:205] Tried to move back new op lower bound from 7315713836598042624 to 7315713836533002240. Current Snapshot: MvccSnapshot[applied={T|T < 7315713836598042624}]
I20260807 00:35:48.393654 19398 mvcc.cc:205] Tried to move back new op lower bound from 7315713836598042624 to 7315713836533002240. Current Snapshot: MvccSnapshot[applied={T|T < 7315713836598042624}]
I20260807 00:35:48.394037 19399 mvcc.cc:205] Tried to move back new op lower bound from 7315713836598042624 to 7315713836533002240. Current Snapshot: MvccSnapshot[applied={T|T < 7315713836598042624}]
I20260807 00:35:48.396889 18889 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:48.397012 18889 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:35:48.397998 18889 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 637c1fbe9b6a418d924b7925e6f5dc23: Sending DeleteTablet for 3 replicas of tablet 832ea198a1fb451c93d068cb32d85e92
I20260807 00:35:48.398561 19298 tablet_service.cc:1514] Processing DeleteTablet for tablet 832ea198a1fb451c93d068cb32d85e92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:48 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:54940
I20260807 00:35:48.398758 19021 tablet_service.cc:1514] Processing DeleteTablet for tablet 832ea198a1fb451c93d068cb32d85e92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:48 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:56296
I20260807 00:35:48.398797 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18954
I20260807 00:35:48.401595 19158 tablet_service.cc:1514] Processing DeleteTablet for tablet 832ea198a1fb451c93d068cb32d85e92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:35:48 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:38740
I20260807 00:35:48.401930 19406 tablet_replica.cc:330] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: stopping tablet replica
I20260807 00:35:48.402056 19406 raft_consensus.cc:2229] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:35:48.402316 19406 raft_consensus.cc:2258] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:48.402954 19406 ts_tablet_manager.cc:1905] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:35:48.405088 19406 ts_tablet_manager.cc:1918] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:48.405208 19406 log.cc:1196] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/832ea198a1fb451c93d068cb32d85e92
I20260807 00:35:48.405625 19406 ts_tablet_manager.cc:1939] T 832ea198a1fb451c93d068cb32d85e92 P 30c0229ccb0145059a84132c8cc353aa: Deleting consensus metadata
I20260807 00:35:48.406278 18875 catalog_manager.cc:4841] TS 30c0229ccb0145059a84132c8cc353aa (127.7.252.2:45793): tablet 832ea198a1fb451c93d068cb32d85e92 (table test-table [id=4baf6a5d30b5493ead71767b047a19ca]) successfully deleted
W20260807 00:35:48.406701 18875 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:45273 (error 108)
I20260807 00:35:48.407521 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 19094
I20260807 00:35:48.408562 19407 tablet_replica.cc:330] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: stopping tablet replica
I20260807 00:35:48.408708 19407 raft_consensus.cc:2229] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:35:48.408831 19407 raft_consensus.cc:2258] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:35:48.409032 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:35:48.407628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45273 (local address 127.0.0.1:56300)
0807 00:35:48.408919 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0807 00:35:48.408976 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1262}
I20260807 00:35:48.409770 19407 ts_tablet_manager.cc:1905] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 00:35:48.410948 18875 catalog_manager.cc:4584] TS 2e3b2cd2c5a046cdb639c57a386d45c6 (127.7.252.1:45273): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 832ea198a1fb451c93d068cb32d85e92: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45273: connect: Connection refused (error 111)
I20260807 00:35:48.411904 19407 ts_tablet_manager.cc:1918] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:35:48.411995 19407 log.cc:1196] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/832ea198a1fb451c93d068cb32d85e92
I20260807 00:35:48.412273 19407 ts_tablet_manager.cc:1939] T 832ea198a1fb451c93d068cb32d85e92 P 67b9da1aeed948068ad9640912040c89: Deleting consensus metadata
I20260807 00:35:48.413272 18877 catalog_manager.cc:4841] TS 67b9da1aeed948068ad9640912040c89 (127.7.252.3:45129): tablet 832ea198a1fb451c93d068cb32d85e92 (table test-table [id=4baf6a5d30b5493ead71767b047a19ca]) successfully deleted
I20260807 00:35:48.415398 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 19231
I20260807 00:35:48.421725 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 18858
2026-08-07T00:35:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2062 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[19411](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[19411](info): set up 2 sockets
Aug 07 00:35:48 dist-test-slave-csg5 krb5kdc[19411](info): commencing operation
krb5kdc: starting...
W20260807 00:35:49.543027 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:35:49 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062949, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:35:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:35:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/rangeradmin_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/rangeradmin_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/rangerlookup_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/rangerlookup_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
I20260807 00:35:49.755677 8176 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task2dG0Jg/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/postgres -l logfile start
2026-08-07 00:35:52.986 UTC [19444] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 00:35:52.986 UTC [19444] LOG: listening on IPv4 address "127.7.252.20", port 34261
2026-08-07 00:35:52.991 UTC [19444] LOG: listening on Unix socket "/tmp/.s.PGSQL.34261"
2026-08-07 00:35:53.016 UTC [19448] LOG: database system was shut down at 2026-08-07 00:35:50 UTC
2026-08-07 00:35:53.020 UTC [19444] LOG: database system is ready to accept connections
I20260807 00:35:54.001859 8176 mini_postgres.cc:96] Postgres bound to 34261
2026-08-07 00:35:54.010 UTC [19456] FATAL: database "slave" does not exist
127.7.252.20:34261 - accepting connections
I20260807 00:35:54.011188 8176 mini_ranger.cc:161] Starting Ranger...
I20260807 00:35:54.031038 8176 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 00:35:54.709345 8176 mini_ranger.cc:87] Created ranger Postgres database
I20260807 00:35:54.709448 8176 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-admin
2026-08-07 00:35:55,031 [I] DB FLAVOR :POSTGRES
2026-08-07 00:35:55,032 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 00:35:55,032 [I] Checking connection..
2026-08-07 00:35:55,032 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 00:35:55,304 [I] Checking connection passed.
2026-08-07 00:35:55,304 [I] --------- Verifying version history table ---------
2026-08-07 00:35:55,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 00:35:55,601 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 00:35:55,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 00:35:55,872 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 00:35:55,872 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 00:35:55,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 00:35:56.158 UTC [19522] WARNING: there is no transaction in progress
2026-08-07 00:35:56,167 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 00:35:56,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 00:35:56,442 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 00:35:56,442 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 00:35:56,442 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 00:35:56,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 00:35:56,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-csg5.c.gcp-upstream.internal','N') ;"
2026-08-07 00:35:57,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 00:35:57,529 [I] Table x_portal_user does not exist in database ranger
2026-08-07 00:35:57,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 00:35:57,806 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 00:35:57,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 00:35:58,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 00:35:58,344 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 00:35:58,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 00:35:59.544 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.568 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.590 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.611 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.632 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.657 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.734 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.745 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.766 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.779 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.792 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.811 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.824 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.832 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.841 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:35:59.851 UTC [19636] WARNING: there is no transaction in progress
2026-08-07 00:36:00,795 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 00:36:00,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 00:36:01,069 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 00:36:01,069 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 00:36:01,380 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 00:36:01,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 00:36:01,669 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 00:36:01,669 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 00:36:01,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 00:36:02,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-csg5.c.gcp-upstream.internal';"
2026-08-07 00:36:02,575 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 00:36:02,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 00:36:02,858 [I] DB_PATCHES have already been applied
I20260807 00:36:02.864583 8176 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-admin:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task2dG0Jg/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 00:36:02.864663 8176 mini_ranger.cc:193] Using host: 127.7.252.20
I20260807 00:36:02.868762 8176 mini_ranger.cc:227] Ranger admin URL: http://127.7.252.20:49659
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 12:36:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 00:36:04.098873 8176 mini_ranger.cc:160] Time spent starting Ranger: real 10.088s user 0.006s sys 0.007s
Aug 07, 2026 12:36:27 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 12:36:27 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 12:36:27 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 12:36:27 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 12:36:28 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 00:36:29.210042 8176 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/rangerkms_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/rangerkms_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.252.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.252.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 00:36:29 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062989, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 00:36:29.315379 8176 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 00:36:29.327940 8176 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 00:36:30.461459 8176 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 00:36:30.461561 8176 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms
I20260807 00:36:30.461582 8176 mini_ranger_kms.cc:227] Using postgres at 127.7.252.20:34261
2026-08-07 00:36:30,741 [I] DB FLAVOR :POSTGRES
2026-08-07 00:36:30,742 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 00:36:30,742 [I] Checking connection
2026-08-07 00:36:30,742 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 00:36:30,995 [I] connection success
2026-08-07 00:36:30,996 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 00:36:30,996 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 00:36:30,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 00:36:31,248 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 00:36:31,249 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 00:36:31,249 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 00:36:31,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34261/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 00:36:31,537 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 00:36:32.071133 8176 mini_ranger_kms.cc:310] Created kms service
I20260807 00:36:32.330363 8176 mini_ranger_kms.cc:326] Created kudu user
I20260807 00:36:32.393126 8176 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 00:36:32 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062989, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:36:32.877727 8176 mini_ranger_kms.cc:384] Added ranger policy
I20260807 00:36:32.877856 8176 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms:/tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 00:36:32.877877 8176 mini_ranger_kms.cc:240] Using host: 127.7.252.20
I20260807 00:36:32.882171 8176 mini_ranger_kms.cc:276] Ranger KMS PID: 19824
I20260807 00:36:32.882332 8176 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.252.20:47941
Aug 07, 2026 12:36:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 12:36:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 12:36:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 12:36:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 12:36:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 12:36:34 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 00:36:35 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786062995, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.252.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:36:35.307286 8176 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.992s user 0.000s sys 0.264s
I20260807 00:36:35.307411 8176 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 00:36:35.307494 8176 mini_ranger_kms.cc:401] 127.7.252.20:47941/kms/v1/keys
Aug 07 00:36:35 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062995, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.252.20@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
Aug 07 00:36:36 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062995, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.252.20@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
Aug 07 00:36:38 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:36:38.551362 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35043
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:35043
--ranger_config_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:47941/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:36:38.639137 19875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:36:38.639374 19875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:36:38.639397 19875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:36:38.640616 19875 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:36:38.640664 19875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:36:38.640678 19875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:36:38.640691 19875 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:36:38.640704 19875 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:36:38.642439 19875 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.252.20:47941/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:35043
--ranger_config_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:36:38.642771 19875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:36:38.643036 19875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:36:38.648874 19881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:36:38.648931 19875 server_base.cc:1034] running on GCE node
W20260807 00:36:38.649011 19883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:38.648896 19880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:36:38.649263 19875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:36:38.649614 19875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:36:38.650781 19875 hybrid_clock.cc:648] HybridClock initialized: now 1786062998650767 us; error 54 us; skew 500 ppm
Aug 07 00:36:38 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062998, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:36:38.657967 19875 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:36:38.658540 19875 webserver.cc:460] Webserver started at http://127.7.252.62:33929/ using document root <none> and password file <none>
I20260807 00:36:38.658841 19875 fs_manager.cc:359] Metadata directory not provided
I20260807 00:36:38.658911 19875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:36:38.659096 19875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:36:38 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062998, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:36:38.711570 19875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "87a8ed8d81264a2b84569d29173f1efc"
format_stamp: "Formatted at 2026-08-07 00:36:38 on dist-test-slave-csg5"
server_key: "c9ba484f608a46d284bb399f03286eaf"
server_key_iv: "21445352bac572c6983343acf9e4af0a"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:38.712070 19875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "87a8ed8d81264a2b84569d29173f1efc"
format_stamp: "Formatted at 2026-08-07 00:36:38 on dist-test-slave-csg5"
server_key: "c9ba484f608a46d284bb399f03286eaf"
server_key_iv: "21445352bac572c6983343acf9e4af0a"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:38.714000 19875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:36:38.728209 19890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:38.728457 19875 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:36:38.728574 19875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "87a8ed8d81264a2b84569d29173f1efc"
format_stamp: "Formatted at 2026-08-07 00:36:38 on dist-test-slave-csg5"
server_key: "c9ba484f608a46d284bb399f03286eaf"
server_key_iv: "21445352bac572c6983343acf9e4af0a"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:38.728703 19875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:36:38.741801 19875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:36:38.744122 19875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:36:38.744309 19875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:36:38.749490 19875 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:35043
I20260807 00:36:38.749540 19943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:35043 every 8 connection(s)
I20260807 00:36:38.749950 19875 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:36:38.750814 19944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:36:38.754110 19944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc: Bootstrap starting.
I20260807 00:36:38.754889 19944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc: Neither blocks nor log segments found. Creating new log.
I20260807 00:36:38.755223 19944 log.cc:824] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc: Log is configured to *not* fsync() on all Append() calls
I20260807 00:36:38.756255 19944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc: No bootstrap required, opened a new log
I20260807 00:36:38.758867 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 19875
I20260807 00:36:38.758994 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:36:38.759200 8176 external_mini_cluster.cc:1428] Setting key e39062654aa06cf8ae9113b529024485
I20260807 00:36:38.759244 19944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87a8ed8d81264a2b84569d29173f1efc" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35043 } }
I20260807 00:36:38.759490 19944 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:36:38.759593 19944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a8ed8d81264a2b84569d29173f1efc, State: Initialized, Role: FOLLOWER
I20260807 00:36:38.759951 19944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87a8ed8d81264a2b84569d29173f1efc" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35043 } }
I20260807 00:36:38.760128 19944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:36:38.760178 19944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:36:38.760221 19944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:36:38.760950 19944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87a8ed8d81264a2b84569d29173f1efc" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35043 } }
I20260807 00:36:38.761063 19944 leader_election.cc:302] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87a8ed8d81264a2b84569d29173f1efc; no voters:
I20260807 00:36:38.761271 19944 leader_election.cc:288] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:36:38.761336 19949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:36:38.761545 19949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [term 1 LEADER]: Becoming Leader. State: Replica: 87a8ed8d81264a2b84569d29173f1efc, State: Running, Role: LEADER
I20260807 00:36:38.761616 19944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:36:38.761729 19949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87a8ed8d81264a2b84569d29173f1efc" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35043 } }
I20260807 00:36:38.762138 19949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87a8ed8d81264a2b84569d29173f1efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87a8ed8d81264a2b84569d29173f1efc" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35043 } } }
I20260807 00:36:38.762285 19949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [sys.catalog]: This master's current role is: LEADER
I20260807 00:36:38.762457 19949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87a8ed8d81264a2b84569d29173f1efc. Latest consensus state: current_term: 1 leader_uuid: "87a8ed8d81264a2b84569d29173f1efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87a8ed8d81264a2b84569d29173f1efc" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35043 } } }
I20260807 00:36:38.762573 19949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc [sys.catalog]: This master's current role is: LEADER
I20260807 00:36:38.763116 19958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:36:38.763305 19944 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 00:36:38.763703 19958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 00:36:38 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:36:38.776539 19958 catalog_manager.cc:1347] Generated new cluster ID: fdea3cda61ff4f25aeefc7dafee3c6f1
I20260807 00:36:38.776616 19958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:36:38.778833 19948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:38.759830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53886 (local address 127.7.252.62:35043)
0807 00:36:38.760058 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:38.760069 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:38.760101 (+ 32us) server_negotiation.cc:407] Connection header received
0807 00:36:38.760247 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:38.760255 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:38.760324 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:38.760471 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:36:38.761130 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:38.762906 (+ 1776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:38.764035 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:38.769675 (+ 5640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:38.773492 (+ 3817us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:38.773626 (+ 134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:36:38.773630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:36:38.773630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:36:38.773642 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:36:38.776801 (+ 3159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:38.777207 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:38.777210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:38.777210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:38.777328 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:38.777509 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:38.777510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:38.777510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:38.777809 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:36:38.778378 (+ 569us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:38.778449 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 00:36:38.778572 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":100,"threads_started":1}
I20260807 00:36:38.784358 19958 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:36:38.785467 19958 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:36:38.795529 19958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc: Generated new TSK 0
I20260807 00:36:38.795925 19958 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:36:39.590708 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:47941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35043
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:36:39.725095 19991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:36:39.725561 19991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:36:39.725660 19991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:36:39.728133 19991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:36:39.728231 19991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:36:39.728283 19991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:36:39.731176 19991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.252.20:47941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:36:39.731695 19991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:36:39.732211 19991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:36:39.740228 20000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:39.740371 19998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:39.740487 19997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:36:39.741286 19991 server_base.cc:1034] running on GCE node
I20260807 00:36:39.741590 19991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:36:39.741957 19991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:36:39.743170 19991 hybrid_clock.cc:648] HybridClock initialized: now 1786062999743139 us; error 41 us; skew 500 ppm
Aug 07 00:36:39 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062999, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:36:39.746994 19991 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:36:39.747602 19991 webserver.cc:460] Webserver started at http://127.7.252.1:42419/ using document root <none> and password file <none>
I20260807 00:36:39.747924 19991 fs_manager.cc:359] Metadata directory not provided
I20260807 00:36:39.747996 19991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:36:39.748154 19991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:36:39 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062999, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:36:39.767617 19991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "11fb37af0f4642dbb19033bda4f18361"
format_stamp: "Formatted at 2026-08-07 00:36:39 on dist-test-slave-csg5"
server_key: "473844fe1b08430083d29139f0d3eee3"
server_key_iv: "c6f21f65cc1ac04753c16f19e249fa79"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:39.768913 19991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "11fb37af0f4642dbb19033bda4f18361"
format_stamp: "Formatted at 2026-08-07 00:36:39 on dist-test-slave-csg5"
server_key: "473844fe1b08430083d29139f0d3eee3"
server_key_iv: "c6f21f65cc1ac04753c16f19e249fa79"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:39.771117 19991 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 00:36:39.786936 20007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:39.787189 19991 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 00:36:39.787284 19991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "11fb37af0f4642dbb19033bda4f18361"
format_stamp: "Formatted at 2026-08-07 00:36:39 on dist-test-slave-csg5"
server_key: "473844fe1b08430083d29139f0d3eee3"
server_key_iv: "c6f21f65cc1ac04753c16f19e249fa79"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:39.787382 19991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:36:39.820111 19991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:36:39.822682 19991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:36:39.822899 19991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:36:39.823197 19991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:36:39.823597 19991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:36:39.823663 19991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:39.823736 19991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:36:39.823817 19991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:39.830741 19991 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:46415
I20260807 00:36:39.833842 20127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:46415 every 8 connection(s)
I20260807 00:36:39.834452 19991 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:36:39 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786062999, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:36:39.843575 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 19991
I20260807 00:36:39.843689 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:36:39.843910 8176 external_mini_cluster.cc:1428] Setting key 6d126ed43122692aa9f8bb13daf9c4c9
I20260807 00:36:39.850939 20131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:39.835618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:37917 (local address 127.7.252.62:35043)
0807 00:36:39.836754 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:39.836757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:39.836766 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:36:39.836794 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:39.836795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:39.836808 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:39.836884 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:36:39.837777 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:39.838513 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:39.839986 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:39.840276 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:39.840343 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:39.843205 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:36:39.843207 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:36:39.843208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:36:39.843217 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:36:39.849021 (+ 5804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:39.849635 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:39.849636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:39.849637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:39.849708 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:39.850013 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:39.850014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:39.850014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:39.850163 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:36:39.850221 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:39.850727 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 00:36:39.850832 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1111,"thread_start_us":71,"threads_started":1}
I20260807 00:36:39.851719 20130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:39.835561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35043 (local address 127.7.252.1:37917)
0807 00:36:39.835900 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:39.835970 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:39.836569 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:39.837020 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:39.837026 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:39.837312 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:36:39.837639 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:39.837647 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:39.838630 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:39.838631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:39.839880 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:39.839883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:39.840418 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:39.840419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:39.840565 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:39.841240 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:36:39.841250 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:36:39.843071 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:36:39.849149 (+ 6078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:36:39.849165 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:36:39.849169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:36:39.849539 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:36:39.849776 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:36:39.849777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:36:39.849777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:36:39.849941 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:36:39.850248 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:36:39.850254 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:36:39.850464 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 00:36:39.850576 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 00:36:39.851477 (+ 901us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":109,"threads_started":1}
I20260807 00:36:39.852443 20128 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35043
I20260807 00:36:39.852535 20128 heartbeater.cc:464] Registering TS with master...
I20260807 00:36:39.852731 20128 heartbeater.cc:511] Master 127.7.252.62:35043 requested a full tablet report, sending...
I20260807 00:36:39.853332 19907 ts_manager.cc:194] Registered new tserver with Master: 11fb37af0f4642dbb19033bda4f18361 (127.7.252.1:46415)
I20260807 00:36:39.854207 19907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:37917
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:36:39.903901 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:47941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35043
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:36:40.048071 20134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:36:40.048477 20134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:36:40.048588 20134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 00:36:40.050714 20134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:36:40.050976 20134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:36:40.051085 20134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:36:40.053663 20134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.252.20:47941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:36:40.054210 20134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:36:40.054960 20134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:36:40.062150 20145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:40.062227 20142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:40.063351 20141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:36:40.063616 20134 server_base.cc:1034] running on GCE node
I20260807 00:36:40.063956 20134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:36:40.064284 20134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:36:40.073472 20134 hybrid_clock.cc:648] HybridClock initialized: now 1786063000073433 us; error 41 us; skew 500 ppm
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:36:40.077764 20134 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:36:40.078472 20134 webserver.cc:460] Webserver started at http://127.7.252.2:37451/ using document root <none> and password file <none>
I20260807 00:36:40.078866 20134 fs_manager.cc:359] Metadata directory not provided
I20260807 00:36:40.078997 20134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:36:40.079229 20134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:36:40.106797 20134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "87b4cbf551f8453198f311f7f4c00cfe"
format_stamp: "Formatted at 2026-08-07 00:36:40 on dist-test-slave-csg5"
server_key: "5ce3710e2d85949b4453f11d8250368b"
server_key_iv: "ffe4bb82883ace0c1a9127ed2ff5fa82"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:40.107878 20134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "87b4cbf551f8453198f311f7f4c00cfe"
format_stamp: "Formatted at 2026-08-07 00:36:40 on dist-test-slave-csg5"
server_key: "5ce3710e2d85949b4453f11d8250368b"
server_key_iv: "ffe4bb82883ace0c1a9127ed2ff5fa82"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:40.110251 20134 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 00:36:40.126636 20152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:40.126984 20134 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:36:40.127094 20134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "87b4cbf551f8453198f311f7f4c00cfe"
format_stamp: "Formatted at 2026-08-07 00:36:40 on dist-test-slave-csg5"
server_key: "5ce3710e2d85949b4453f11d8250368b"
server_key_iv: "ffe4bb82883ace0c1a9127ed2ff5fa82"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:40.127260 20134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:36:40.152971 20134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:36:40.155826 20134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:36:40.156006 20134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:36:40.156316 20134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:36:40.156744 20134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:36:40.156802 20134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:40.156845 20134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:36:40.156868 20134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:40.164419 20134 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:43315
I20260807 00:36:40.165429 20134 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:36:40.167641 20273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:43315 every 8 connection(s)
I20260807 00:36:40.170962 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 20134
I20260807 00:36:40.171082 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:36:40.171271 8176 external_mini_cluster.cc:1428] Setting key 76c95b2407afbeb16e79db37a87a1ca1
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:36:40.179947 20131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.168722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:34905 (local address 127.7.252.62:35043)
0807 00:36:40.168810 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.168813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.168953 (+ 140us) server_negotiation.cc:407] Connection header received
0807 00:36:40.169717 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.169719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.169731 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.169763 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:36:40.170619 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.171435 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.173009 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.173325 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.173380 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.176314 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:36:40.176315 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:36:40.176316 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:36:40.176324 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:36:40.178188 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:40.178754 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:40.178755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:40.178755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:40.178821 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:40.179101 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:40.179102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:40.179103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:40.179246 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:36:40.179293 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.179718 (+ 425us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.179827 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 00:36:40.180809 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.168420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35043 (local address 127.7.252.2:34905)
0807 00:36:40.168812 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.168861 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.169585 (+ 724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.169953 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.169958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.170222 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:36:40.170511 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.170516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.171643 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.171644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.172899 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.172903 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.173474 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.173475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.173624 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.174265 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:36:40.174276 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:36:40.176190 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:36:40.178296 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:36:40.178304 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:36:40.178306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:36:40.178630 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:36:40.178893 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:36:40.178893 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:36:40.178894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:36:40.179026 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:36:40.179360 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:36:40.179367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:36:40.179555 (+ 188us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.180371 (+ 816us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.180555 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":92,"threads_started":1}
I20260807 00:36:40.181561 20274 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35043
I20260807 00:36:40.181656 20274 heartbeater.cc:464] Registering TS with master...
I20260807 00:36:40.181854 20274 heartbeater.cc:511] Master 127.7.252.62:35043 requested a full tablet report, sending...
I20260807 00:36:40.182296 19907 ts_manager.cc:194] Registered new tserver with Master: 87b4cbf551f8453198f311f7f4c00cfe (127.7.252.2:43315)
I20260807 00:36:40.182811 19907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:34905
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:36:40.227018 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:47941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35043
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:36:40.325022 20279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:36:40.325331 20279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:36:40.325379 20279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:36:40.326809 20279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:36:40.326889 20279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:36:40.326942 20279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:36:40.329677 20279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.252.20:47941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:36:40.329981 20279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:36:40.330292 20279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:36:40.337545 20287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:40.337545 20284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:36:40.338021 20285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:36:40.338305 20279 server_base.cc:1034] running on GCE node
I20260807 00:36:40.338685 20279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:36:40.339008 20279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:36:40.340198 20279 hybrid_clock.cc:648] HybridClock initialized: now 1786063000340058 us; error 167 us; skew 500 ppm
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:36:40.343590 20279 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:36:40.344169 20279 webserver.cc:460] Webserver started at http://127.7.252.3:39225/ using document root <none> and password file <none>
I20260807 00:36:40.344446 20279 fs_manager.cc:359] Metadata directory not provided
I20260807 00:36:40.344512 20279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:36:40.344661 20279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:36:40.380440 20279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "2ade0b41a18f489e826ad41c535f89d9"
format_stamp: "Formatted at 2026-08-07 00:36:40 on dist-test-slave-csg5"
server_key: "51e26c68107159b20d12b0fc9e0992a1"
server_key_iv: "c6c8dbcdda479eb879ec75eaf9116e1d"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:40.381009 20279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "2ade0b41a18f489e826ad41c535f89d9"
format_stamp: "Formatted at 2026-08-07 00:36:40 on dist-test-slave-csg5"
server_key: "51e26c68107159b20d12b0fc9e0992a1"
server_key_iv: "c6c8dbcdda479eb879ec75eaf9116e1d"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:40.382484 20279 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260807 00:36:40.405524 20294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:40.405829 20279 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:36:40.405958 20279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "2ade0b41a18f489e826ad41c535f89d9"
format_stamp: "Formatted at 2026-08-07 00:36:40 on dist-test-slave-csg5"
server_key: "51e26c68107159b20d12b0fc9e0992a1"
server_key_iv: "c6c8dbcdda479eb879ec75eaf9116e1d"
server_key_version: "kuduclusterkey@0"
I20260807 00:36:40.406075 20279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:36:40.436913 20279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:36:40.439671 20279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:36:40.439837 20279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:36:40.440117 20279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:36:40.440531 20279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:36:40.440588 20279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:40.440626 20279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:36:40.440649 20279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:36:40.448575 20279 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:37609
I20260807 00:36:40.449060 20279 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:36:40.451774 20412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:37609 every 8 connection(s)
I20260807 00:36:40.455175 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 20279
I20260807 00:36:40.455299 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:36:40.455502 8176 external_mini_cluster.cc:1428] Setting key 7bc846423a5b739827389ad6b423b88b
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:36:40.464924 20131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.451600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:38355 (local address 127.7.252.62:35043)
0807 00:36:40.451647 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.451649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.452245 (+ 596us) server_negotiation.cc:407] Connection header received
0807 00:36:40.453098 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.453100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.453115 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.453149 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:36:40.454194 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.455037 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.457192 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.457507 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.457552 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.461120 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:36:40.461122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:36:40.461122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:36:40.461131 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:36:40.462960 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:40.463688 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:40.463689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:40.463689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:40.463758 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:40.464075 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:40.464076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:40.464076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:40.464226 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:36:40.464273 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.464725 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.464821 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:36:40.466064 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.451267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35043 (local address 127.7.252.3:38355)
0807 00:36:40.452105 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.452149 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.452945 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.453366 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.453371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.453718 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:36:40.454068 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.454076 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.455164 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.455165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.457081 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.457084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.457651 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.457652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.457808 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.459044 (+ 1236us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:36:40.459055 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:36:40.460984 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:36:40.463073 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:36:40.463220 (+ 147us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:36:40.463224 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:36:40.463585 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:36:40.463838 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:36:40.463840 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:36:40.463841 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:36:40.463994 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:36:40.464339 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:36:40.464346 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:36:40.464550 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.465535 (+ 985us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.465794 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"thread_start_us":116,"threads_started":1}
I20260807 00:36:40.467159 20413 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35043
I20260807 00:36:40.467272 20413 heartbeater.cc:464] Registering TS with master...
I20260807 00:36:40.467502 20413 heartbeater.cc:511] Master 127.7.252.62:35043 requested a full tablet report, sending...
I20260807 00:36:40.468252 19907 ts_manager.cc:194] Registered new tserver with Master: 2ade0b41a18f489e826ad41c535f89d9 (127.7.252.3:37609)
I20260807 00:36:40.468720 19907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:38355
I20260807 00:36:40.479178 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:36:40.489614 20131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.481015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53896 (local address 127.7.252.62:35043)
0807 00:36:40.481082 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.481084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.481432 (+ 348us) server_negotiation.cc:407] Connection header received
0807 00:36:40.481537 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.481538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.481550 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.481581 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:36:40.482392 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.483243 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.484354 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.484647 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.484691 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.486429 (+ 1738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:36:40.486431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:36:40.486431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:36:40.486439 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:36:40.488294 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:40.488689 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:40.488695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:40.488695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:40.488771 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:36:40.488992 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:36:40.488993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:36:40.488994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:36:40.489116 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:36:40.489228 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.489395 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.489496 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 00:36:40.491539 19907 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:36:40.493917 19907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:36:40.503630 20429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.496913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37609 (local address 127.0.0.1:48880)
0807 00:36:40.498277 (+ 1364us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.498283 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.498345 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.499271 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.499272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.499274 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:36:40.499309 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.499310 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.500930 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.500932 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.502241 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.502244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.503337 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.503338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.503428 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.503445 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.503492 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.503543 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1352,"thread_start_us":84,"threads_started":1}
I20260807 00:36:40.504302 20431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.497433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48880 (local address 127.7.252.3:37609)
0807 00:36:40.497628 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.497633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.498351 (+ 718us) server_negotiation.cc:407] Connection header received
0807 00:36:40.498410 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.498412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.498429 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.499387 (+ 958us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:36:40.499467 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.500638 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.502362 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.503237 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.504057 (+ 820us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.504153 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.504179 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.504218 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":123,"threads_started":1}
I20260807 00:36:40.505219 20323 tablet_service.cc:1467] Processing CreateTablet for tablet d382e9fed5fb4822961bb07d8b6e8acd (DEFAULT_TABLE table=test-table [id=712d83d14c534b8da89cb318f908bab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:36:40.505671 20323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d382e9fed5fb4822961bb07d8b6e8acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:36:40.505779 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.497080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:46415 (local address 127.0.0.1:57970)
0807 00:36:40.498465 (+ 1385us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.498474 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.498853 (+ 379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.499170 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.499174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.499177 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:36:40.499271 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.499273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.501185 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.501186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.503716 (+ 2530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.503719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.505537 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.505538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.505603 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.505608 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.505657 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.505705 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1327,"mutex_wait_us":7,"thread_start_us":76,"threads_started":1}
I20260807 00:36:40.506063 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.497653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57970 (local address 127.7.252.1:46415)
0807 00:36:40.498085 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.498089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.498527 (+ 438us) server_negotiation.cc:407] Connection header received
0807 00:36:40.498948 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.498951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.498967 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.499020 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:36:40.499986 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.501095 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.503818 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.505367 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.505419 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.505473 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.505919 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.505966 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":50,"threads_started":1}
I20260807 00:36:40.506767 20059 tablet_service.cc:1467] Processing CreateTablet for tablet d382e9fed5fb4822961bb07d8b6e8acd (DEFAULT_TABLE table=test-table [id=712d83d14c534b8da89cb318f908bab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:36:40.507107 20059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d382e9fed5fb4822961bb07d8b6e8acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:36:40.514918 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.496680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43315 (local address 127.0.0.1:32942)
0807 00:36:40.498003 (+ 1323us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.498133 (+ 130us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.498186 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.499370 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.499371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.499373 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:36:40.499402 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.499403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.512057 (+ 12654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.512058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.513426 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.513431 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.514572 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.514573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.514639 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.514644 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.514750 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.514806 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1285,"thread_start_us":86,"threads_started":1}
I20260807 00:36:40.514963 20428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.496873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32942 (local address 127.7.252.2:43315)
0807 00:36:40.498648 (+ 1775us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.498693 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.498704 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:36:40.498744 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.498746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.498761 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.499474 (+ 713us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:36:40.499546 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.503370 (+ 3824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.513559 (+ 10189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.514474 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.514573 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.514733 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.514777 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.514821 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1707,"thread_start_us":87,"threads_started":1}
I20260807 00:36:40.515254 20434 tablet_bootstrap.cc:492] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: Bootstrap starting.
I20260807 00:36:40.516114 20193 tablet_service.cc:1467] Processing CreateTablet for tablet d382e9fed5fb4822961bb07d8b6e8acd (DEFAULT_TABLE table=test-table [id=712d83d14c534b8da89cb318f908bab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:36:40.516536 20193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d382e9fed5fb4822961bb07d8b6e8acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:36:40.516765 20434 tablet_bootstrap.cc:654] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: Neither blocks nor log segments found. Creating new log.
I20260807 00:36:40.517132 20434 log.cc:824] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: Log is configured to *not* fsync() on all Append() calls
I20260807 00:36:40.517596 20433 tablet_bootstrap.cc:492] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Bootstrap starting.
I20260807 00:36:40.518460 20433 tablet_bootstrap.cc:654] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Neither blocks nor log segments found. Creating new log.
I20260807 00:36:40.518904 20433 log.cc:824] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Log is configured to *not* fsync() on all Append() calls
I20260807 00:36:40.519414 20434 tablet_bootstrap.cc:492] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: No bootstrap required, opened a new log
I20260807 00:36:40.519488 20434 ts_tablet_manager.cc:1397] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 00:36:40.519938 20433 tablet_bootstrap.cc:492] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: No bootstrap required, opened a new log
I20260807 00:36:40.519999 20433 ts_tablet_manager.cc:1397] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:36:40.522176 20433 raft_consensus.cc:348] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.522399 20433 raft_consensus.cc:374] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:36:40.522455 20433 raft_consensus.cc:729] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ade0b41a18f489e826ad41c535f89d9, State: Initialized, Role: FOLLOWER
I20260807 00:36:40.522441 20434 raft_consensus.cc:348] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.522588 20434 raft_consensus.cc:374] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:36:40.522626 20434 raft_consensus.cc:729] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11fb37af0f4642dbb19033bda4f18361, State: Initialized, Role: FOLLOWER
I20260807 00:36:40.522579 20433 consensus_queue.cc:260] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.522771 20434 consensus_queue.cc:260] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.522965 20433 ts_tablet_manager.cc:1428] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 00:36:40.523036 20434 ts_tablet_manager.cc:1428] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 00:36:40.523098 20413 heartbeater.cc:503] Master 127.7.252.62:35043 was elected leader, sending a full tablet report...
I20260807 00:36:40.523142 20128 heartbeater.cc:503] Master 127.7.252.62:35043 was elected leader, sending a full tablet report...
I20260807 00:36:40.526996 20438 tablet_bootstrap.cc:492] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Bootstrap starting.
I20260807 00:36:40.528281 20438 tablet_bootstrap.cc:654] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Neither blocks nor log segments found. Creating new log.
I20260807 00:36:40.528684 20438 log.cc:824] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Log is configured to *not* fsync() on all Append() calls
I20260807 00:36:40.529671 20438 tablet_bootstrap.cc:492] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: No bootstrap required, opened a new log
I20260807 00:36:40.529752 20438 ts_tablet_manager.cc:1397] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:36:40.532510 20438 raft_consensus.cc:348] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.532730 20438 raft_consensus.cc:374] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:36:40.532835 20438 raft_consensus.cc:729] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b4cbf551f8453198f311f7f4c00cfe, State: Initialized, Role: FOLLOWER
I20260807 00:36:40.533062 20438 consensus_queue.cc:260] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.533479 20438 ts_tablet_manager.cc:1428] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 00:36:40.533962 20274 heartbeater.cc:503] Master 127.7.252.62:35043 was elected leader, sending a full tablet report...
W20260807 00:36:40.590494 20129 tablet.cc:2369] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 00:36:40 dist-test-slave-csg5 krb5kdc[19411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063000, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
W20260807 00:36:40.668627 20275 tablet.cc:2369] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:36:40.700958 20414 tablet.cc:2369] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:36:40.814085 20442 raft_consensus.cc:482] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:36:40.814247 20442 raft_consensus.cc:504] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.814788 20442 leader_election.cc:288] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ade0b41a18f489e826ad41c535f89d9 (127.7.252.3:37609), 11fb37af0f4642dbb19033bda4f18361 (127.7.252.1:46415)
I20260807 00:36:40.820137 20431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.815674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:50477 (local address 127.7.252.3:37609)
0807 00:36:40.815729 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.815731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.816061 (+ 330us) server_negotiation.cc:407] Connection header received
0807 00:36:40.816190 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.816191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.816205 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.816242 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:36:40.816546 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.817350 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.819055 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.819697 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.819752 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.819764 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.820005 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.820052 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 00:36:40.820680 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.815117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:37609 (local address 127.7.252.2:50477)
0807 00:36:40.815974 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.815988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.816097 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.816333 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.816334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.816337 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:36:40.816451 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.816454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.817506 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.817507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.818912 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.818915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.819838 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.819839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.819908 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.819912 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.820525 (+ 613us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.820582 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":102,"threads_started":1}
I20260807 00:36:40.821278 20363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d382e9fed5fb4822961bb07d8b6e8acd" candidate_uuid: "87b4cbf551f8453198f311f7f4c00cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ade0b41a18f489e826ad41c535f89d9" is_pre_election: true
I20260807 00:36:40.821480 20363 raft_consensus.cc:2454] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b4cbf551f8453198f311f7f4c00cfe in term 0.
I20260807 00:36:40.821681 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.815860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:45835 (local address 127.7.252.1:46415)
0807 00:36:40.815916 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.815918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.817980 (+ 2062us) server_negotiation.cc:407] Connection header received
0807 00:36:40.818088 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.818089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.818102 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.818131 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:36:40.818364 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.819064 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.820578 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.821281 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.821328 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.821337 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.821573 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.821613 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 00:36:40.821923 20155 leader_election.cc:302] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ade0b41a18f489e826ad41c535f89d9, 87b4cbf551f8453198f311f7f4c00cfe; no voters:
I20260807 00:36:40.821979 20444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.815354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:46415 (local address 127.7.252.2:45835)
0807 00:36:40.817893 (+ 2539us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.817906 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:36:40.818013 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:36:40.818193 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:36:40.818194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:36:40.818196 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:36:40.818265 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.818266 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.819165 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.819166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.820469 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:36:40.820472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.821426 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.821427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:36:40.821497 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.821500 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:36:40.821808 (+ 308us) client_negotiation.cc:240] Negotiation successful
0807 00:36:40.821848 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2520,"thread_start_us":52,"threads_started":1}
I20260807 00:36:40.822167 20442 raft_consensus.cc:2781] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:36:40.822224 20442 raft_consensus.cc:482] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:36:40.822248 20442 raft_consensus.cc:3037] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:36:40.822352 20074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d382e9fed5fb4822961bb07d8b6e8acd" candidate_uuid: "87b4cbf551f8453198f311f7f4c00cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11fb37af0f4642dbb19033bda4f18361" is_pre_election: true
I20260807 00:36:40.822535 20074 raft_consensus.cc:2454] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b4cbf551f8453198f311f7f4c00cfe in term 0.
I20260807 00:36:40.823802 20442 raft_consensus.cc:504] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.823961 20442 leader_election.cc:288] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [CANDIDATE]: Term 1 election: Requested vote from peers 2ade0b41a18f489e826ad41c535f89d9 (127.7.252.3:37609), 11fb37af0f4642dbb19033bda4f18361 (127.7.252.1:46415)
I20260807 00:36:40.824252 20074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d382e9fed5fb4822961bb07d8b6e8acd" candidate_uuid: "87b4cbf551f8453198f311f7f4c00cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11fb37af0f4642dbb19033bda4f18361"
I20260807 00:36:40.824359 20074 raft_consensus.cc:3037] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:36:40.825402 20074 raft_consensus.cc:2454] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b4cbf551f8453198f311f7f4c00cfe in term 1.
I20260807 00:36:40.825650 20363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d382e9fed5fb4822961bb07d8b6e8acd" candidate_uuid: "87b4cbf551f8453198f311f7f4c00cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ade0b41a18f489e826ad41c535f89d9"
I20260807 00:36:40.825754 20363 raft_consensus.cc:3037] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:36:40.826620 20155 leader_election.cc:302] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11fb37af0f4642dbb19033bda4f18361, 87b4cbf551f8453198f311f7f4c00cfe; no voters:
I20260807 00:36:40.826785 20442 raft_consensus.cc:2781] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:36:40.827041 20442 raft_consensus.cc:686] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 1 LEADER]: Becoming Leader. State: Replica: 87b4cbf551f8453198f311f7f4c00cfe, State: Running, Role: LEADER
I20260807 00:36:40.827178 20442 consensus_queue.cc:237] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } }
I20260807 00:36:40.827483 20363 raft_consensus.cc:2454] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b4cbf551f8453198f311f7f4c00cfe in term 1.
I20260807 00:36:40.828207 19906 catalog_manager.cc:5495] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b4cbf551f8453198f311f7f4c00cfe (127.7.252.2). New cstate: current_term: 1 leader_uuid: "87b4cbf551f8453198f311f7f4c00cfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b4cbf551f8453198f311f7f4c00cfe" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 } health_report { overall_health: UNKNOWN } } }
I20260807 00:36:40.857626 20428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.853519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.7.252.2:43315)
0807 00:36:40.853569 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:36:40.853571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:36:40.853580 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:36:40.853632 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:36:40.853632 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:36:40.853654 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:36:40.853735 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:36:40.853871 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.854633 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.856122 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:36:40.856624 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:36:40.856722 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:36:40.856962 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:36:40.857111 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:36:40.857210 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 00:36:40.857516 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 00:36:40.857539 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:36:40.860491 20074 raft_consensus.cc:1261] T d382e9fed5fb4822961bb07d8b6e8acd P 11fb37af0f4642dbb19033bda4f18361 [term 1 FOLLOWER]: Refusing update from remote peer 87b4cbf551f8453198f311f7f4c00cfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:36:40.860693 20363 raft_consensus.cc:1261] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 1 FOLLOWER]: Refusing update from remote peer 87b4cbf551f8453198f311f7f4c00cfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:36:40.861042 20442 consensus_queue.cc:1035] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "11fb37af0f4642dbb19033bda4f18361" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:36:40.861243 20442 consensus_queue.cc:1035] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ade0b41a18f489e826ad41c535f89d9" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 37609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:36:40.866324 20449 mvcc.cc:205] Tried to move back new op lower bound from 7315714051519438848 to 7315714051388899328. Current Snapshot: MvccSnapshot[applied={T|T < 7315714051519438848}]
I20260807 00:36:40.866477 20451 mvcc.cc:205] Tried to move back new op lower bound from 7315714051519438848 to 7315714051388899328. Current Snapshot: MvccSnapshot[applied={T|T < 7315714051519438848}]
I20260807 00:36:40.869272 19906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:36:40.869424 19906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:36:40.870253 19906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87a8ed8d81264a2b84569d29173f1efc: Sending DeleteTablet for 3 replicas of tablet d382e9fed5fb4822961bb07d8b6e8acd
I20260807 00:36:40.870832 20193 tablet_service.cc:1514] Processing DeleteTablet for tablet d382e9fed5fb4822961bb07d8b6e8acd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:36:40 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:32942
I20260807 00:36:40.871584 20323 tablet_service.cc:1514] Processing DeleteTablet for tablet d382e9fed5fb4822961bb07d8b6e8acd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:36:40 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:48880
I20260807 00:36:40.871974 20059 tablet_service.cc:1514] Processing DeleteTablet for tablet d382e9fed5fb4822961bb07d8b6e8acd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:36:40 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:57970
I20260807 00:36:40.872488 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 19991
I20260807 00:36:40.886826 20460 tablet_replica.cc:330] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: stopping tablet replica
I20260807 00:36:40.887696 20460 raft_consensus.cc:2229] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:36:40.894912 20460 raft_consensus.cc:2258] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:36:40.895402 20459 tablet_replica.cc:330] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: stopping tablet replica
I20260807 00:36:40.896087 20460 ts_tablet_manager.cc:1905] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:36:40.896318 20459 raft_consensus.cc:2229] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:36:40.896597 20459 raft_consensus.cc:2258] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:36:40.898725 20460 ts_tablet_manager.cc:1918] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:36:40.898875 20460 log.cc:1196] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/d382e9fed5fb4822961bb07d8b6e8acd
I20260807 00:36:40.899480 20459 ts_tablet_manager.cc:1905] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:36:40.899600 20460 ts_tablet_manager.cc:1939] T d382e9fed5fb4822961bb07d8b6e8acd P 2ade0b41a18f489e826ad41c535f89d9: Deleting consensus metadata
I20260807 00:36:40.900146 19893 catalog_manager.cc:4841] TS 2ade0b41a18f489e826ad41c535f89d9 (127.7.252.3:37609): tablet d382e9fed5fb4822961bb07d8b6e8acd (table test-table [id=712d83d14c534b8da89cb318f908bab7]) successfully deleted
I20260807 00:36:40.901585 20459 ts_tablet_manager.cc:1918] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:36:40.901712 20459 log.cc:1196] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/d382e9fed5fb4822961bb07d8b6e8acd
I20260807 00:36:40.902031 20459 ts_tablet_manager.cc:1939] T d382e9fed5fb4822961bb07d8b6e8acd P 87b4cbf551f8453198f311f7f4c00cfe: Deleting consensus metadata
I20260807 00:36:40.902571 19893 catalog_manager.cc:4841] TS 87b4cbf551f8453198f311f7f4c00cfe (127.7.252.2:43315): tablet d382e9fed5fb4822961bb07d8b6e8acd (table test-table [id=712d83d14c534b8da89cb318f908bab7]) successfully deleted
W20260807 00:36:40.904748 19893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:46415 (error 108)
I20260807 00:36:40.905898 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:36:40.905722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:46415 (local address 127.0.0.1:57982)
0807 00:36:40.905787 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 00:36:40.905845 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:46415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 00:36:40.906148 19893 catalog_manager.cc:4584] TS 11fb37af0f4642dbb19033bda4f18361 (127.7.252.1:46415): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d382e9fed5fb4822961bb07d8b6e8acd: Network error: Client connection negotiation failed: client connection to 127.7.252.1:46415: connect: Connection refused (error 111)
I20260807 00:36:40.906433 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 20134
I20260807 00:36:40.915432 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 20279
I20260807 00:36:40.923348 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 19875
I20260807 00:36:40.931550 8176 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 00:36:41.277199 8176 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 00:36:41.277333 8176 mini_ranger.cc:66] Stopping Ranger...
I20260807 00:36:41.622699 8176 mini_ranger.cc:68] Stopped Ranger
2026-08-07 00:36:41.622 UTC [19444] LOG: received smart shutdown request
2026-08-07 00:36:41.627 UTC [19444] LOG: background worker "logical replication launcher" (PID 19454) exited with exit code 1
2026-08-07 00:36:41.628 UTC [19449] LOG: shutting down
2026-08-07 00:36:41.846 UTC [19444] LOG: database system is shut down
2026-08-07T00:36:41Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53542 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:36:42 dist-test-slave-csg5 krb5kdc[20474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:36:42 dist-test-slave-csg5 krb5kdc[20474](info): set up 2 sockets
Aug 07 00:36:42 dist-test-slave-csg5 krb5kdc[20474](info): commencing operation
krb5kdc: starting...
W20260807 00:36:43.088557 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:36:43 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:36:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:36:43Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/rangeradmin_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/rangeradmin_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/rangerlookup_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/rangerlookup_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
I20260807 00:36:43.295521 8176 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task2dG0Jg/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/postgres -l logfile start
2026-08-07 00:36:46.480 UTC [20505] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 00:36:46.481 UTC [20505] LOG: listening on IPv4 address "127.7.252.20", port 34375
2026-08-07 00:36:46.486 UTC [20505] LOG: listening on Unix socket "/tmp/.s.PGSQL.34375"
2026-08-07 00:36:46.513 UTC [20508] LOG: database system was shut down at 2026-08-07 00:36:44 UTC
2026-08-07 00:36:46.518 UTC [20505] LOG: database system is ready to accept connections
I20260807 00:36:47.512933 8176 mini_postgres.cc:96] Postgres bound to 34375
2026-08-07 00:36:47.520 UTC [20517] FATAL: database "slave" does not exist
127.7.252.20:34375 - accepting connections
I20260807 00:36:47.520978 8176 mini_ranger.cc:161] Starting Ranger...
I20260807 00:36:47.538069 8176 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 00:36:48.178431 8176 mini_ranger.cc:87] Created ranger Postgres database
I20260807 00:36:48.178510 8176 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-admin
2026-08-07 00:36:48,468 [I] DB FLAVOR :POSTGRES
2026-08-07 00:36:48,468 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 00:36:48,469 [I] Checking connection..
2026-08-07 00:36:48,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 00:36:48,749 [I] Checking connection passed.
2026-08-07 00:36:48,749 [I] --------- Verifying version history table ---------
2026-08-07 00:36:48,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 00:36:49,027 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 00:36:49,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 00:36:49,313 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 00:36:49,314 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 00:36:49,314 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 00:36:49.589 UTC [20586] WARNING: there is no transaction in progress
2026-08-07 00:36:49,597 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 00:36:49,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 00:36:49,889 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 00:36:49,889 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 00:36:49,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 00:36:50,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 00:36:50,430 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-csg5.c.gcp-upstream.internal','N') ;"
2026-08-07 00:36:50,675 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 00:36:50,946 [I] Table x_portal_user does not exist in database ranger
2026-08-07 00:36:50,947 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 00:36:51,201 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 00:36:51,201 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 00:36:51,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 00:36:51,731 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 00:36:51,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 00:36:52.932 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:52.954 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:52.976 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:52.998 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.018 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.043 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.109 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.118 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.136 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.149 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.163 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.180 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.192 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.201 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.210 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:53.219 UTC [20698] WARNING: there is no transaction in progress
2026-08-07 00:36:54,179 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 00:36:54,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 00:36:54,444 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 00:36:54,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 00:36:54,751 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 00:36:54,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 00:36:55,024 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 00:36:55,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 00:36:55,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 00:36:55,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-csg5.c.gcp-upstream.internal';"
2026-08-07 00:36:55,839 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 00:36:55,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 00:36:56,113 [I] DB_PATCHES have already been applied
I20260807 00:36:56.120857 8176 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-admin:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task2dG0Jg/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 00:36:56.120935 8176 mini_ranger.cc:193] Using host: 127.7.252.20
I20260807 00:36:56.125190 8176 mini_ranger.cc:227] Ranger admin URL: http://127.7.252.20:56129
Aug 07, 2026 12:36:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 12:36:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 12:36:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 12:36:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 12:36:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 12:36:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 12:36:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 00:36:57.316138 8176 mini_ranger.cc:160] Time spent starting Ranger: real 9.795s user 0.000s sys 0.012s
Aug 07, 2026 12:37:20 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 12:37:20 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 12:37:20 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 12:37:20 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 12:37:21 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 00:37:22.082125 8176 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.252.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.252.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/rangerkms_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.252.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/rangerkms_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.252.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.252.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.252.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/HTTP_127.7.252.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 00:37:22 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063042, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 00:37:22.184600 8176 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 00:37:22.196146 8176 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 00:37:23.429472 8176 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 00:37:23.429571 8176 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms
I20260807 00:37:23.429592 8176 mini_ranger_kms.cc:227] Using postgres at 127.7.252.20:34375
2026-08-07 00:37:23,614 [I] DB FLAVOR :POSTGRES
2026-08-07 00:37:23,615 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 00:37:23,615 [I] Checking connection
2026-08-07 00:37:23,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 00:37:23,883 [I] connection success
2026-08-07 00:37:23,883 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 00:37:23,883 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 00:37:23,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 00:37:24,158 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 00:37:24,158 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 00:37:24,158 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 00:37:24,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.252.20:34375/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 00:37:24,461 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 00:37:25.040131 8176 mini_ranger_kms.cc:310] Created kms service
I20260807 00:37:25.270566 8176 mini_ranger_kms.cc:326] Created kudu user
I20260807 00:37:25.332247 8176 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 00:37:25 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063042, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:25.801357 8176 mini_ranger_kms.cc:384] Added ranger policy
I20260807 00:37:25.801571 8176 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms:/tmp/dist-test-task2dG0Jg/build/release/bin/postgresql.jar:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task2dG0Jg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 00:37:25.801599 8176 mini_ranger_kms.cc:240] Using host: 127.7.252.20
I20260807 00:37:25.807528 8176 mini_ranger_kms.cc:276] Ranger KMS PID: 20891
I20260807 00:37:25.807646 8176 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.252.20:56733
Aug 07, 2026 12:37:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 12:37:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 12:37:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 12:37:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 12:37:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 12:37:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 00:37:28 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786063048, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.252.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:28.154796 8176 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.970s user 0.000s sys 0.165s
I20260807 00:37:28.154901 8176 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 00:37:28.154954 8176 mini_ranger_kms.cc:401] 127.7.252.20:56733/kms/v1/keys
Aug 07 00:37:28 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063048, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.252.20@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
Aug 07 00:37:28 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063048, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.252.20@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
Aug 07 00:37:31 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:37:31.457180 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36587
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:36587
--ranger_config_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:31.545514 20944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:31.545801 20944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:31.545921 20944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:31.547295 20944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:31.547389 20944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:31.547415 20944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:31.547437 20944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:31.547467 20944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:31.549647 20944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.252.20:56733/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:36587
--ranger_config_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:31.550019 20944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:31.550313 20944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:31.557602 20950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:31.557605 20952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:31.557605 20949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:31.559243 20944 server_base.cc:1034] running on GCE node
I20260807 00:37:31.559625 20944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:31.560030 20944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:31.561220 20944 hybrid_clock.cc:648] HybridClock initialized: now 1786063051561193 us; error 39 us; skew 500 ppm
Aug 07 00:37:31 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063051, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:31.569711 20944 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:31.570276 20944 webserver.cc:460] Webserver started at http://127.7.252.62:34755/ using document root <none> and password file <none>
I20260807 00:37:31.570566 20944 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:31.570633 20944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:31.570824 20944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:37:31 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063051, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:31.622614 20944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "5895239a223e410da793f87ca8d8fdb6"
format_stamp: "Formatted at 2026-08-07 00:37:31 on dist-test-slave-csg5"
server_key: "c5731c414afd8a0e45079cbd1264939f"
server_key_iv: "fea2fb4201b8a1c074a4238ae54fa575"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:31.623116 20944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "5895239a223e410da793f87ca8d8fdb6"
format_stamp: "Formatted at 2026-08-07 00:37:31 on dist-test-slave-csg5"
server_key: "c5731c414afd8a0e45079cbd1264939f"
server_key_iv: "fea2fb4201b8a1c074a4238ae54fa575"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:31.624650 20944 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:31.643519 20959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:31.643796 20944 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:37:31.643903 20944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "5895239a223e410da793f87ca8d8fdb6"
format_stamp: "Formatted at 2026-08-07 00:37:31 on dist-test-slave-csg5"
server_key: "c5731c414afd8a0e45079cbd1264939f"
server_key_iv: "fea2fb4201b8a1c074a4238ae54fa575"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:31.644006 20944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:31.656512 20944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:31.658849 20944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:31.659019 20944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:31.663661 20944 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:36587
I20260807 00:37:31.663707 21011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:36587 every 8 connection(s)
I20260807 00:37:31.664086 20944 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:31.664813 21012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:31.665355 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 20944
I20260807 00:37:31.665462 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:37:31.665670 8176 external_mini_cluster.cc:1428] Setting key ef59366b60d7a0246f2db697384eb9b5
I20260807 00:37:31.668139 21012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Bootstrap starting.
I20260807 00:37:31.668777 21012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:31.669076 21012 log.cc:824] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:31.669855 21012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: No bootstrap required, opened a new log
I20260807 00:37:31.672438 21012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:31.672676 21012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:31.672716 21012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5895239a223e410da793f87ca8d8fdb6, State: Initialized, Role: FOLLOWER
I20260807 00:37:31.672936 21012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:31.673040 21012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:37:31.673081 21012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:37:31.673166 21012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:31.673930 21012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:31.674072 21012 leader_election.cc:302] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5895239a223e410da793f87ca8d8fdb6; no voters:
Aug 07 00:37:31 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:31.674310 21012 leader_election.cc:288] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:37:31.674499 21018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:31.674678 21012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:31.674706 21018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 LEADER]: Becoming Leader. State: Replica: 5895239a223e410da793f87ca8d8fdb6, State: Running, Role: LEADER
I20260807 00:37:31.674850 21018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:31.675207 21018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5895239a223e410da793f87ca8d8fdb6. Latest consensus state: current_term: 1 leader_uuid: "5895239a223e410da793f87ca8d8fdb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } } }
I20260807 00:37:31.675287 21018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:31.675673 21019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5895239a223e410da793f87ca8d8fdb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } } }
I20260807 00:37:31.675812 21019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:31.676016 21023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:31.676342 21012 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 00:37:31.676566 21023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:37:31.678244 21034 mvcc.cc:205] Tried to move back new op lower bound from 7315714259672096768 to 7315714259660509184. Current Snapshot: MvccSnapshot[applied={T|T < 7315714259672096768}]
I20260807 00:37:31.678815 21023 catalog_manager.cc:1347] Generated new cluster ID: 6deb76381de647f0a23b9862fdbd62b3
I20260807 00:37:31.678862 21023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:37:31.679068 21015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:31.666341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38234 (local address 127.7.252.62:36587)
0807 00:37:31.666563 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:31.666574 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:31.666695 (+ 121us) server_negotiation.cc:407] Connection header received
0807 00:37:31.667295 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:31.667304 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:31.667370 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:31.667532 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:31.668355 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:31.669716 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:31.670830 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:31.671491 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:31.671614 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:31.674852 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:31.674857 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:31.674858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:31.674871 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:31.676931 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:31.677387 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:31.677390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:31.677391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:31.677491 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:31.677682 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:31.677682 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:31.677683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:31.677991 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:31.678146 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:31.678712 (+ 566us) server_negotiation.cc:299] Negotiation successful
0807 00:37:31.678851 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260807 00:37:31.716106 21023 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:37:31.717190 21023 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:37:31.727226 21023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Generated new TSK 0
I20260807 00:37:31.727589 21023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:37:32.506457 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36587
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:32.634924 21058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:32.635336 21058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:32.635430 21058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:32.637648 21058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:32.637804 21058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:32.637897 21058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:37:32.640503 21058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.252.20:56733/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:32.641105 21058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:32.641486 21058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:32.649173 21064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:32.649211 21065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:32.649609 21067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:32.650096 21058 server_base.cc:1034] running on GCE node
I20260807 00:37:32.650338 21058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:32.650753 21058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:32.652007 21058 hybrid_clock.cc:648] HybridClock initialized: now 1786063052651970 us; error 51 us; skew 500 ppm
Aug 07 00:37:32 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:32.657567 21058 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:37:32.658242 21058 webserver.cc:460] Webserver started at http://127.7.252.1:44821/ using document root <none> and password file <none>
I20260807 00:37:32.658605 21058 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:32.658800 21058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:32.659075 21058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:37:32 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:32.676450 21058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "d221c006f7a5b21c38771145b5d61e1f"
server_key_iv: "18c39bc856c5d7750cca8d01cf64d4ff"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:32.677208 21058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "d221c006f7a5b21c38771145b5d61e1f"
server_key_iv: "18c39bc856c5d7750cca8d01cf64d4ff"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:32.691296 21058 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.002s sys 0.000s
I20260807 00:37:32.711185 21074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:32.711436 21058 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260807 00:37:32.711546 21058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "d221c006f7a5b21c38771145b5d61e1f"
server_key_iv: "18c39bc856c5d7750cca8d01cf64d4ff"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:32.711674 21058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:32.744549 21058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:32.747527 21058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:32.747722 21058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:32.748004 21058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:32.748445 21058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:32.748507 21058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:32.748545 21058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:32.748566 21058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:32.757202 21058 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:33623
I20260807 00:37:32.757596 21191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:33623 every 8 connection(s)
I20260807 00:37:32.757746 21058 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:37:32 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:32.765702 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21058
I20260807 00:37:32.765828 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:37:32.766076 8176 external_mini_cluster.cc:1428] Setting key f80bea2cdd8f9836125d3b6f9ffc3435
I20260807 00:37:32.769438 21195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:32.758606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36587 (local address 127.7.252.1:52043)
0807 00:37:32.758880 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:32.758930 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:32.759591 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:32.759910 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:32.759920 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:32.760141 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:32.760365 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:32.760369 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:32.761179 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:32.761181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:32.762100 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:32.762103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:32.762590 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:32.762591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:32.762807 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:32.763484 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:32.763495 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:32.764971 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:32.767372 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:32.767381 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:32.767383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:32.767765 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:32.768007 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:32.768008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:32.768009 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:32.768183 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:32.768534 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:32.768541 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:32.768760 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 00:37:32.768886 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 00:37:32.769099 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":165,"threads_started":1}
I20260807 00:37:32.769853 21196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:32.758991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:52043 (local address 127.7.252.62:36587)
0807 00:37:32.759127 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:32.759130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:32.759142 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:37:32.759717 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:32.759718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:32.759735 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:32.759828 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:32.760477 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:32.761063 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:32.762221 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:32.762476 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:32.762568 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:32.765099 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:32.765100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:32.765101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:32.765110 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:32.767271 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:32.767860 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:32.767861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:32.767861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:32.767935 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:32.768273 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:32.768275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:32.768275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:32.768437 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:32.768504 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:32.769631 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0807 00:37:32.769738 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260807 00:37:32.770423 21192 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36587
I20260807 00:37:32.770562 21192 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:32.770803 21192 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:32.771479 20976 ts_manager.cc:194] Registered new tserver with Master: 16c8774bc7bd417b9f0d3e9a6a53dfba (127.7.252.1:33623)
I20260807 00:37:32.772526 20976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:52043
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:37:32.803027 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36587
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:37:32 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 00:37:32.927078 21199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:32.927438 21199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:32.927482 21199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:32.929503 21199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:32.929628 21199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:32.929706 21199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:37:32.932386 21199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.252.20:56733/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:32.932837 21199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:32.933156 21199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:32.940104 21206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:32.940490 21209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:32.941613 21199 server_base.cc:1034] running on GCE node
W20260807 00:37:32.941915 21207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:32.942236 21199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:32.942533 21199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:32.943711 21199 hybrid_clock.cc:648] HybridClock initialized: now 1786063052943684 us; error 41 us; skew 500 ppm
Aug 07 00:37:32 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:32.947264 21199 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:37:32.947840 21199 webserver.cc:460] Webserver started at http://127.7.252.2:36457/ using document root <none> and password file <none>
I20260807 00:37:32.948173 21199 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:32.948251 21199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:32.948441 21199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:37:32 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:32.965749 21199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "9b449eeca71242c88f470d1d8facc63e"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "926f94cb9297cb7cf276d80cd159af80"
server_key_iv: "a5efd689cfdfa7e94ab1acc2f23d5c61"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:32.966269 21199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "9b449eeca71242c88f470d1d8facc63e"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "926f94cb9297cb7cf276d80cd159af80"
server_key_iv: "a5efd689cfdfa7e94ab1acc2f23d5c61"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:32.972630 21199 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 00:37:32.987388 21216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:32.987694 21199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 00:37:32.987798 21199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "9b449eeca71242c88f470d1d8facc63e"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "926f94cb9297cb7cf276d80cd159af80"
server_key_iv: "a5efd689cfdfa7e94ab1acc2f23d5c61"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:32.987905 21199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:33.032768 21199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:33.035516 21199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:33.035688 21199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:33.035931 21199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:33.036357 21199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:33.036410 21199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.036443 21199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:33.036463 21199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.044266 21199 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:33745
I20260807 00:37:33.044322 21334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:33745 every 8 connection(s)
I20260807 00:37:33.044736 21199 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:37:33.046909 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21199
I20260807 00:37:33.047016 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:37:33.047235 8176 external_mini_cluster.cc:1428] Setting key b845bee1b8bde156d85cf226fb7385aa
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063052, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:33.059340 21196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:33.045578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:52611 (local address 127.7.252.62:36587)
0807 00:37:33.045633 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:33.045635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:33.047675 (+ 2040us) server_negotiation.cc:407] Connection header received
0807 00:37:33.048453 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:33.048454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:33.048466 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:33.048498 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:33.049380 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.050165 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.051731 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.052048 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.052131 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:33.055502 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:33.055504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:33.055504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:33.055514 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:33.057460 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:33.058020 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:33.058022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:33.058022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:33.058091 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:33.058425 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:33.058426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:33.058426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:33.058576 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:33.058635 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:33.059092 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 00:37:33.059202 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:37:33.060170 21337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:33.045549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36587 (local address 127.7.252.2:52611)
0807 00:37:33.047505 (+ 1956us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:33.047563 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:33.048314 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:33.048694 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:33.048699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:33.048957 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:33.049246 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:33.049253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.050290 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.050290 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:33.051630 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:33.051633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.052331 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.052333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:33.052498 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:33.053541 (+ 1043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:33.053553 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:33.055363 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:33.057568 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:33.057577 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:33.057580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:33.057916 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:33.058168 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:33.058169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:33.058169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:33.058341 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:33.058709 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:33.058716 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:33.058916 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 00:37:33.059714 (+ 798us) client_negotiation.cc:240] Negotiation successful
0807 00:37:33.059921 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1900,"thread_start_us":85,"threads_started":1}
I20260807 00:37:33.060969 21335 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36587
I20260807 00:37:33.061081 21335 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:33.061299 21335 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:33.061702 20976 ts_manager.cc:194] Registered new tserver with Master: 9b449eeca71242c88f470d1d8facc63e (127.7.252.2:33745)
I20260807 00:37:33.062191 20976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:52611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:37:33.087064 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36587
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:33.206784 21341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:33.207038 21341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:33.207082 21341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:33.208366 21341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:33.208436 21341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:33.208485 21341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:37:33.210177 21341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.252.20:56733/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:36587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:33.210482 21341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:33.210803 21341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:33.216200 21349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:33.218942 21341 server_base.cc:1034] running on GCE node
W20260807 00:37:33.219271 21346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:33.219491 21347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:33.219743 21341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:33.220036 21341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:33.221699 21341 hybrid_clock.cc:648] HybridClock initialized: now 1786063053221671 us; error 42 us; skew 500 ppm
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:33.225520 21341 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:37:33.226186 21341 webserver.cc:460] Webserver started at http://127.7.252.3:43997/ using document root <none> and password file <none>
I20260807 00:37:33.226491 21341 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:33.226572 21341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:33.226789 21341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:33.244843 21341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "acd24e53eaad4160b4c34030ce548242"
format_stamp: "Formatted at 2026-08-07 00:37:33 on dist-test-slave-csg5"
server_key: "aad52a02b375337656303ab4fedaaa8d"
server_key_iv: "03a1226bfcafda3fb8ae245cc21cfacd"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:33.245347 21341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "acd24e53eaad4160b4c34030ce548242"
format_stamp: "Formatted at 2026-08-07 00:37:33 on dist-test-slave-csg5"
server_key: "aad52a02b375337656303ab4fedaaa8d"
server_key_iv: "03a1226bfcafda3fb8ae245cc21cfacd"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:33.248010 21341 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 00:37:33.278764 21356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.279014 21341 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260807 00:37:33.279138 21341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "acd24e53eaad4160b4c34030ce548242"
format_stamp: "Formatted at 2026-08-07 00:37:33 on dist-test-slave-csg5"
server_key: "aad52a02b375337656303ab4fedaaa8d"
server_key_iv: "03a1226bfcafda3fb8ae245cc21cfacd"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:33.279287 21341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:33.322578 21341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:33.326267 21341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:33.326462 21341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:33.326815 21341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:33.327248 21341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:33.327307 21341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.327348 21341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:33.327379 21341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.335434 21341 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:38397
I20260807 00:37:33.336010 21341 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:37:33.339676 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21341
I20260807 00:37:33.339804 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:37:33.340039 8176 external_mini_cluster.cc:1428] Setting key 80ff0028995f195c7c1a109ed4f080a7
I20260807 00:37:33.347075 21477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:38397 every 8 connection(s)
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:33.359457 21196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:33.347863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:46663 (local address 127.7.252.62:36587)
0807 00:37:33.347911 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:33.347913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:33.348491 (+ 578us) server_negotiation.cc:407] Connection header received
0807 00:37:33.349217 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:33.349218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:33.349232 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:33.349300 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:33.350082 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.350938 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.352380 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.352695 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.352780 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:33.355639 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:33.355641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:33.355641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:33.355651 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:33.357532 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:33.358181 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:33.358183 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:33.358183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:33.358256 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:33.358581 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:33.358582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:33.358582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:33.358767 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:33.358845 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:33.359255 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 00:37:33.359360 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:37:33.360339 21481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:33.347887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36587 (local address 127.7.252.3:46663)
0807 00:37:33.348279 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:33.348374 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:33.349102 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:33.349385 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:33.349390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:33.349658 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:33.349971 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:33.349977 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.351052 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.351054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:33.352272 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:33.352275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.352811 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.352812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:33.352955 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:33.353663 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:33.353674 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:33.355495 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:33.357650 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:33.357660 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:33.357663 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:33.358087 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:33.358338 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:33.358339 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:33.358339 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:33.358500 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:33.358847 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:33.358856 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:33.359068 (+ 212us) client_negotiation.cc:769] Sending connection context
0807 00:37:33.359863 (+ 795us) client_negotiation.cc:240] Negotiation successful
0807 00:37:33.360062 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":143,"threads_started":1}
I20260807 00:37:33.360924 21478 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36587
I20260807 00:37:33.361042 21478 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:33.361281 21478 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:33.361971 20976 ts_manager.cc:194] Registered new tserver with Master: acd24e53eaad4160b4c34030ce548242 (127.7.252.3:38397)
I20260807 00:37:33.362491 20976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:46663
I20260807 00:37:33.363353 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:37:33.364053 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21058
I20260807 00:37:33.376036 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21199
I20260807 00:37:33.383057 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21341
I20260807 00:37:33.391469 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 20944
I20260807 00:37:33.399247 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36587
--webserver_interface=127.7.252.62
--webserver_port=34755
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:36587
--ranger_config_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:33.491034 21483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:33.491276 21483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:33.491302 21483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:33.492528 21483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:33.492578 21483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:33.492594 21483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:33.492605 21483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:33.492617 21483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:33.494294 21483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:36587
--ranger_config_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:36587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=34755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:33.494570 21483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:33.494877 21483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:33.501212 21491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:33.501427 21483 server_base.cc:1034] running on GCE node
W20260807 00:37:33.501215 21488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:33.501282 21489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:33.501885 21483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:33.502243 21483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:33.503458 21483 hybrid_clock.cc:648] HybridClock initialized: now 1786063053503437 us; error 37 us; skew 500 ppm
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:33.506814 21483 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:33.507354 21483 webserver.cc:460] Webserver started at http://127.7.252.62:34755/ using document root <none> and password file <none>
I20260807 00:37:33.507615 21483 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:33.507700 21483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:33.582135 21483 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:33.583097 21499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.583540 21483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:33.583642 21483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "5895239a223e410da793f87ca8d8fdb6"
format_stamp: "Formatted at 2026-08-07 00:37:31 on dist-test-slave-csg5"
server_key: "c5731c414afd8a0e45079cbd1264939f"
server_key_iv: "fea2fb4201b8a1c074a4238ae54fa575"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:33.584169 21483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:33.610081 21483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:33.612293 21483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:33.612483 21483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:33.617058 21483 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:36587
I20260807 00:37:33.617102 21552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:36587 every 8 connection(s)
I20260807 00:37:33.617559 21483 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:33.618938 21553 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:37:33.619609 21553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Bootstrap starting.
I20260807 00:37:33.627686 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21483
I20260807 00:37:33.628046 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:33623
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:36587
--webserver_port=44821
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:33.628324 21553 log.cc:824] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:33.630769 21553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:37:33.631114 21553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Bootstrap complete.
I20260807 00:37:33.635403 21553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:33.635852 21553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5895239a223e410da793f87ca8d8fdb6, State: Initialized, Role: FOLLOWER
I20260807 00:37:33.636065 21553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:33.636160 21553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:37:33.636221 21553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:37:33.636286 21553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 1 FOLLOWER]: Advancing to term 2
I20260807 00:37:33.638137 21553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:33.638281 21553 leader_election.cc:302] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5895239a223e410da793f87ca8d8fdb6; no voters:
I20260807 00:37:33.638525 21553 leader_election.cc:288] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 00:37:33.638646 21557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 00:37:33.638865 21553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:33.638867 21557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [term 2 LEADER]: Becoming Leader. State: Replica: 5895239a223e410da793f87ca8d8fdb6, State: Running, Role: LEADER
I20260807 00:37:33.639024 21557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } }
I20260807 00:37:33.639523 21558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5895239a223e410da793f87ca8d8fdb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } } }
I20260807 00:37:33.639518 21559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5895239a223e410da793f87ca8d8fdb6. Latest consensus state: current_term: 2 leader_uuid: "5895239a223e410da793f87ca8d8fdb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5895239a223e410da793f87ca8d8fdb6" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 36587 } } }
I20260807 00:37:33.639807 21559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:33.639796 21558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:33.640535 21568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:33.640666 21553 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 00:37:33.641101 21568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:37:33.644100 21568 catalog_manager.cc:1259] Loaded cluster ID: 6deb76381de647f0a23b9862fdbd62b3
I20260807 00:37:33.644222 21568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:37:33.646301 21568 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:37:33.646559 21568 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Loaded TSK: 0
I20260807 00:37:33.646826 21568 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 00:37:33.755569 21556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:33.755883 21556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:33.755921 21556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:33.757872 21556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:33.757952 21556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:33.757997 21556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:37:33.760516 21556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:33623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=44821
--tserver_master_addrs=127.7.252.62:36587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:33.760814 21556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:33.761107 21556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:33.768101 21592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:33.768165 21593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:33.768392 21595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:33.768415 21556 server_base.cc:1034] running on GCE node
I20260807 00:37:33.768816 21556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:33.769125 21556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:33.770310 21556 hybrid_clock.cc:648] HybridClock initialized: now 1786063053770272 us; error 50 us; skew 500 ppm
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:33.773862 21556 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:37:33.774478 21556 webserver.cc:460] Webserver started at http://127.7.252.1:44821/ using document root <none> and password file <none>
I20260807 00:37:33.774844 21556 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:33.774955 21556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:33.796597 21556 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260807 00:37:33.799314 21604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.799521 21556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 00:37:33.799620 21556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "d221c006f7a5b21c38771145b5d61e1f"
server_key_iv: "18c39bc856c5d7750cca8d01cf64d4ff"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:33.800118 21556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:33.829417 21556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:33.831830 21556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:33.832020 21556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:33.832324 21556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:33.832773 21556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:33.832839 21556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.832878 21556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:33.832903 21556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:33.841439 21556 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:33623
I20260807 00:37:33.841490 21720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:33623 every 8 connection(s)
I20260807 00:37:33.842054 21556 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:37:33.846555 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21556
I20260807 00:37:33.846925 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:33745
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:36587
--webserver_port=36457
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:33.857975 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:33.843425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:59913 (local address 127.7.252.62:36587)
0807 00:37:33.844226 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:33.844236 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:33.844280 (+ 44us) server_negotiation.cc:407] Connection header received
0807 00:37:33.844444 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:33.844450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:33.844511 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:33.845012 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:33.846519 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.848104 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.849904 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.850581 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.851315 (+ 734us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:33.853459 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:33.853463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:33.853464 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:33.853475 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:33.855653 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:33.856167 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:33.856171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:33.856171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:33.856279 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:33.856604 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:33.856605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:33.856605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:33.856950 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:33.857049 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:33.857585 (+ 536us) server_negotiation.cc:299] Negotiation successful
0807 00:37:33.857715 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":88,"threads_started":1}
I20260807 00:37:33.857993 21723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:33.842977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36587 (local address 127.7.252.1:59913)
0807 00:37:33.843167 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:33.843244 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:33.843973 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:33.844738 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:33.844743 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:33.846046 (+ 1303us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:33.846356 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:33.846364 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.848265 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.848266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:33.849750 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:33.849754 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:33.850763 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:33.850764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:33.850940 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:33.851666 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:33.851676 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:33.853279 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:33.855760 (+ 2481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:33.855771 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:33.855773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:33.856047 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:33.856375 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:33.856376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:33.856377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:33.856512 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:33.857043 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:33.857051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:33.857224 (+ 173us) client_negotiation.cc:769] Sending connection context
0807 00:37:33.857503 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 00:37:33.857715 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260807 00:37:33.859544 21721 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36587
I20260807 00:37:33.859688 21721 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:33.859903 21721 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
W20260807 00:37:33.860911 21721 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:36587 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 00:37:33.861004 21721 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:33.861083 21721 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:33.861476 21721 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:33.861567 21721 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
W20260807 00:37:33.861881 21721 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 00:37:33.979494 21726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:33.979928 21726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:33.980031 21726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:33.982198 21726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:33.982349 21726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:33.982457 21726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:37:33.985260 21726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:33745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=36457
--tserver_master_addrs=127.7.252.62:36587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:33.985620 21726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:33.986029 21726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:33.992389 21731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:33.992336 21732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:33.992736 21734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:33.993242 21726 server_base.cc:1034] running on GCE node
I20260807 00:37:33.993531 21726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:33.993816 21726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:33.995000 21726 hybrid_clock.cc:648] HybridClock initialized: now 1786063053994972 us; error 45 us; skew 500 ppm
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:33.998064 21726 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:37:33.998718 21726 webserver.cc:460] Webserver started at http://127.7.252.2:36457/ using document root <none> and password file <none>
I20260807 00:37:33.999035 21726 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:33.999130 21726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 00:37:33 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:34.018998 21726 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:34.020226 21742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:34.020515 21726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:34.020679 21726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "9b449eeca71242c88f470d1d8facc63e"
format_stamp: "Formatted at 2026-08-07 00:37:32 on dist-test-slave-csg5"
server_key: "926f94cb9297cb7cf276d80cd159af80"
server_key_iv: "a5efd689cfdfa7e94ab1acc2f23d5c61"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:34.021268 21726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:34.052297 21726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:34.054622 21726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:34.054865 21726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:34.055146 21726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:34.055547 21726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:34.055603 21726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:34.055644 21726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:34.055670 21726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:34.062857 21726 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:33745
I20260807 00:37:34.063019 21861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:33745 every 8 connection(s)
I20260807 00:37:34.063333 21726 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
Aug 07 00:37:34 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063053, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:34.071785 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21726
I20260807 00:37:34.072140 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.252.20:56733/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:38397
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:36587
--webserver_port=43997
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:34.076267 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:34.064176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:39613 (local address 127.7.252.62:36587)
0807 00:37:34.064263 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:34.064266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:34.064636 (+ 370us) server_negotiation.cc:407] Connection header received
0807 00:37:34.065343 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:34.065345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:34.065362 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:34.065428 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:34.066199 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.066859 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.068414 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.068639 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.068750 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:34.071914 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:34.071917 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:34.071917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:34.071927 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:34.074070 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:34.074776 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:34.074777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:34.074778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:34.074851 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:34.075221 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:34.075223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:34.075223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:34.075424 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:34.075494 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:34.075964 (+ 470us) server_negotiation.cc:299] Negotiation successful
0807 00:37:34.076098 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 00:37:34.076941 21864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:34.064150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36587 (local address 127.7.252.2:39613)
0807 00:37:34.064428 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:34.064483 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:34.065196 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:34.065512 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:34.065516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:34.065782 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:34.066077 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:34.066084 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.066958 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.066960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:34.068284 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:34.068287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.068767 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.068768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:34.068950 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:34.069633 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:34.069644 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:34.071688 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:34.074207 (+ 2519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:34.074219 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:34.074223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:34.074616 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:34.074938 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:34.074938 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:34.074939 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:34.075121 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:34.075526 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:34.075534 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:34.075767 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 00:37:34.076404 (+ 637us) client_negotiation.cc:240] Negotiation successful
0807 00:37:34.076624 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":101,"threads_started":1}
I20260807 00:37:34.077580 21862 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36587
I20260807 00:37:34.077725 21862 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.077960 21862 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
W20260807 00:37:34.078783 21862 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:36587 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 00:37:34.078900 21862 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.078987 21862 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:34.079401 21862 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.079488 21862 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
W20260807 00:37:34.079994 21862 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 00:37:34.204864 21865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:34.205129 21865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:34.205204 21865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:34.206554 21865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:34.206607 21865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:34.206646 21865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:37:34.208639 21865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.252.20:56733/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:38397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=43997
--tserver_master_addrs=127.7.252.62:36587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:34.208945 21865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:34.209188 21865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:34.214910 21874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:34.215008 21871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:34.214910 21872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:34.216564 21865 server_base.cc:1034] running on GCE node
I20260807 00:37:34.216936 21865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:34.217257 21865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:34.218462 21865 hybrid_clock.cc:648] HybridClock initialized: now 1786063054218441 us; error 45 us; skew 500 ppm
Aug 07 00:37:34 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063054, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:34.222247 21865 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:37:34.222870 21865 webserver.cc:460] Webserver started at http://127.7.252.3:43997/ using document root <none> and password file <none>
I20260807 00:37:34.223157 21865 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:34.223237 21865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 00:37:34 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063054, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:34.245743 21865 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260807 00:37:34.247011 21882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:34.247252 21865 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:34.247361 21865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "acd24e53eaad4160b4c34030ce548242"
format_stamp: "Formatted at 2026-08-07 00:37:33 on dist-test-slave-csg5"
server_key: "aad52a02b375337656303ab4fedaaa8d"
server_key_iv: "03a1226bfcafda3fb8ae245cc21cfacd"
server_key_version: "kuduclusterkey@0"
I20260807 00:37:34.247882 21865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:34.266582 21865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:34.269435 21865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:34.269613 21865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:34.269950 21865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:34.270373 21865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:34.270417 21865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:34.270450 21865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:34.270470 21865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:34.278050 21865 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:38397
I20260807 00:37:34.278643 21865 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:37:34.284379 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 21865
I20260807 00:37:34.290433 22001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:38397 every 8 connection(s)
I20260807 00:37:34.298518 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:34.284928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.7.252.62:36587)
0807 00:37:34.284988 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:34.284991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:34.288387 (+ 3396us) server_negotiation.cc:407] Connection header received
0807 00:37:34.288505 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:34.288506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:34.288523 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:34.288629 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:34.289859 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.290897 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.293032 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.293403 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.293499 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:34.295168 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:34.295170 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:34.295170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:34.295179 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:34.297096 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:34.297527 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:34.297528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:34.297529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:34.297596 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:34.297852 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:34.297853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:34.297854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:34.298009 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:34.298202 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:34.298285 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 00:37:34.298404 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 07 00:37:34 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063054, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:34.308976 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:34.291643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:36587 (local address 127.7.252.3:37637)
0807 00:37:34.291893 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:34.291954 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:34.292680 (+ 726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:34.293886 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:34.293891 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:34.294837 (+ 946us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:34.295562 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:34.295572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.299357 (+ 3785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.299358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:34.300849 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:34.300853 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.301537 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.301539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:34.301708 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:34.302443 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:34.302455 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:34.304441 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:34.306775 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:34.306786 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:34.306789 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:34.307150 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:34.307412 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:34.307413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:34.307413 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:34.307575 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:34.307903 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:34.307910 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:34.308275 (+ 365us) client_negotiation.cc:769] Sending connection context
0807 00:37:34.308491 (+ 216us) client_negotiation.cc:240] Negotiation successful
0807 00:37:34.308691 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":120,"threads_started":1}
I20260807 00:37:34.309588 22005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:34.291313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:37637 (local address 127.7.252.62:36587)
0807 00:37:34.293253 (+ 1940us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:34.293255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:34.293265 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:37:34.293290 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:34.293291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:34.293306 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:34.293383 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:34.295704 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.299214 (+ 3510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.300973 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:34.301351 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:34.301427 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:34.304583 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:34.304585 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:34.304585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:34.304595 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:34.306628 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:34.307251 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:34.307253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:34.307253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:34.307322 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:34.307654 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:34.307655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:34.307655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:34.307809 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:34.307872 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:34.309373 (+ 1501us) server_negotiation.cc:299] Negotiation successful
0807 00:37:34.309482 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1912,"thread_start_us":95,"threads_started":1}
I20260807 00:37:34.310431 22002 heartbeater.cc:347] Connected to a master server at 127.7.252.62:36587
I20260807 00:37:34.310559 22002 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.310849 22002 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
W20260807 00:37:34.311676 22002 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:36587 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 00:37:34.311748 22002 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.311825 22002 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:34.312247 22002 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.312327 22002 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
W20260807 00:37:34.312726 22002 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 00:37:34 dist-test-slave-csg5 krb5kdc[20474](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786063054, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:34.862097 21721 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:34.862296 21721 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:34.862788 21516 ts_manager.cc:194] Registered new tserver with Master: 16c8774bc7bd417b9f0d3e9a6a53dfba (127.7.252.1:33623)
I20260807 00:37:34.863541 21516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:59913
I20260807 00:37:35.080211 21862 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:35.080385 21862 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:35.080686 21516 ts_manager.cc:194] Registered new tserver with Master: 9b449eeca71242c88f470d1d8facc63e (127.7.252.2:33745)
I20260807 00:37:35.081278 21516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:39613
I20260807 00:37:35.312904 22002 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:35.313060 22002 heartbeater.cc:511] Master 127.7.252.62:36587 requested a full tablet report, sending...
I20260807 00:37:35.313357 21516 ts_manager.cc:194] Registered new tserver with Master: acd24e53eaad4160b4c34030ce548242 (127.7.252.3:38397)
Aug 07 00:37:35 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063054, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:35.313860 21516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:37637
I20260807 00:37:35.331794 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:37:35.350348 22023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.332929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38258 (local address 127.7.252.62:36587)
0807 00:37:35.337564 (+ 4635us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.337567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.337709 (+ 142us) server_negotiation.cc:407] Connection header received
0807 00:37:35.337806 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.337807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.337820 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.337921 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:35.338743 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.339588 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.340666 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.340969 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.341059 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.343709 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:35.343710 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:35.343711 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:35.343721 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:35.346541 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:35.347043 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:35.347044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:35.347045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:35.347462 (+ 417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:35.347722 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:35.347723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:35.347723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:35.349017 (+ 1294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:35.349120 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.349973 (+ 853us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.350232 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4603,"thread_start_us":69,"threads_started":1}
I20260807 00:37:35.357511 21516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:37:35.360061 21516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:37:35.377401 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.368346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:38397 (local address 127.0.0.1:42344)
0807 00:37:35.371743 (+ 3397us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.371757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:35.371809 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:35.372877 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:35.372878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:35.372880 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:35.372921 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.372922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.374261 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.374262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.375515 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.375518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.376989 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.376990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.377090 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.377106 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 00:37:35.377174 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 00:37:35.377296 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3373,"thread_start_us":58,"threads_started":1}
I20260807 00:37:35.378049 22033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.369010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42344 (local address 127.7.252.3:38397)
0807 00:37:35.369968 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.369972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.371874 (+ 1902us) server_negotiation.cc:407] Connection header received
0807 00:37:35.371920 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.371923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.371942 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.372013 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:35.373016 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.374145 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.375619 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.376557 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.376632 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.376694 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.377915 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.377967 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924,"thread_start_us":51,"threads_started":1}
I20260807 00:37:35.378944 21917 tablet_service.cc:1467] Processing CreateTablet for tablet ce1a3061bdbb4e7e94d60932a7682613 (DEFAULT_TABLE table=test-table [id=3b6ee6bee0c9461fae5ed7123f511951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:35.379354 21917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1a3061bdbb4e7e94d60932a7682613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:35.380069 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.368110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:33745 (local address 127.0.0.1:55024)
0807 00:37:35.369433 (+ 1323us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.369479 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:35.369552 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:35.370083 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:35.370086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:35.370088 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:35.370166 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.370168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.372158 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.372159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.375536 (+ 3377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.375541 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.379806 (+ 4265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.379807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.379878 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.379883 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:37:35.379940 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:37:35.379987 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1226,"thread_start_us":91,"threads_started":1}
I20260807 00:37:35.380393 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.368843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55024 (local address 127.7.252.2:33745)
0807 00:37:35.369687 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.369693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.369703 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:37:35.369739 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.369741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.369758 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.369827 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:35.370266 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.371558 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.375673 (+ 4115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.377176 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.377250 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.377320 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.380228 (+ 2908us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.380287 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":75,"threads_started":1}
I20260807 00:37:35.382863 22029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.368499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:33623 (local address 127.0.0.1:52104)
0807 00:37:35.376384 (+ 7885us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.376397 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:35.376452 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:35.377359 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:35.377360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:35.377363 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:35.377439 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.377440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.378898 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.378899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.381277 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.381281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.382541 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.382542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.382618 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.382622 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:35.382732 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 00:37:35.382780 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7862,"thread_start_us":59,"threads_started":1}
I20260807 00:37:35.383097 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.369152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.7.252.1:33623)
0807 00:37:35.370039 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.370043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.376735 (+ 6692us) server_negotiation.cc:407] Connection header received
0807 00:37:35.376784 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.376787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.376806 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.376886 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:35.377565 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.378799 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.381403 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.382197 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.382272 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.382438 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.382963 (+ 525us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.383016 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":856,"thread_start_us":69,"threads_started":1}
I20260807 00:37:35.383236 21792 tablet_service.cc:1467] Processing CreateTablet for tablet ce1a3061bdbb4e7e94d60932a7682613 (DEFAULT_TABLE table=test-table [id=3b6ee6bee0c9461fae5ed7123f511951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:35.383589 21792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1a3061bdbb4e7e94d60932a7682613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:35.385244 21653 tablet_service.cc:1467] Processing CreateTablet for tablet ce1a3061bdbb4e7e94d60932a7682613 (DEFAULT_TABLE table=test-table [id=3b6ee6bee0c9461fae5ed7123f511951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:35.385654 21653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1a3061bdbb4e7e94d60932a7682613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:35.387591 22036 tablet_bootstrap.cc:492] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Bootstrap starting.
I20260807 00:37:35.388554 22036 tablet_bootstrap.cc:654] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:35.389207 22036 log.cc:824] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:35.390362 22036 tablet_bootstrap.cc:492] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: No bootstrap required, opened a new log
I20260807 00:37:35.390434 22036 ts_tablet_manager.cc:1397] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:37:35.391654 22035 tablet_bootstrap.cc:492] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Bootstrap starting.
I20260807 00:37:35.392827 22035 tablet_bootstrap.cc:654] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:35.393236 22035 log.cc:824] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:35.393553 22036 raft_consensus.cc:348] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.393692 22039 tablet_bootstrap.cc:492] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: Bootstrap starting.
I20260807 00:37:35.393725 22036 raft_consensus.cc:374] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:35.393757 22036 raft_consensus.cc:729] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b449eeca71242c88f470d1d8facc63e, State: Initialized, Role: FOLLOWER
I20260807 00:37:35.394086 22036 consensus_queue.cc:260] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.394431 22039 tablet_bootstrap.cc:654] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:35.394531 22036 ts_tablet_manager.cc:1428] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260807 00:37:35.394757 21862 heartbeater.cc:503] Master 127.7.252.62:36587 was elected leader, sending a full tablet report...
I20260807 00:37:35.394912 22039 log.cc:824] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:35.396250 22035 tablet_bootstrap.cc:492] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: No bootstrap required, opened a new log
I20260807 00:37:35.396348 22035 ts_tablet_manager.cc:1397] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 00:37:35.396699 22039 tablet_bootstrap.cc:492] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: No bootstrap required, opened a new log
I20260807 00:37:35.396823 22039 ts_tablet_manager.cc:1397] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 00:37:35.399554 22039 raft_consensus.cc:348] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.399843 22039 raft_consensus.cc:374] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:35.399926 22039 raft_consensus.cc:729] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c8774bc7bd417b9f0d3e9a6a53dfba, State: Initialized, Role: FOLLOWER
I20260807 00:37:35.400151 22039 consensus_queue.cc:260] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.400226 22035 raft_consensus.cc:348] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.400447 22035 raft_consensus.cc:374] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:35.400503 22035 raft_consensus.cc:729] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acd24e53eaad4160b4c34030ce548242, State: Initialized, Role: FOLLOWER
I20260807 00:37:35.400699 22039 ts_tablet_manager.cc:1428] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260807 00:37:35.400667 22035 consensus_queue.cc:260] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.400889 21721 heartbeater.cc:503] Master 127.7.252.62:36587 was elected leader, sending a full tablet report...
I20260807 00:37:35.400979 22035 ts_tablet_manager.cc:1428] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 00:37:35.401130 22002 heartbeater.cc:503] Master 127.7.252.62:36587 was elected leader, sending a full tablet report...
W20260807 00:37:35.544093 22003 tablet.cc:2369] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:37:35.565023 21863 tablet.cc:2369] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:37:35.575438 22044 raft_consensus.cc:482] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:35.575613 22044 raft_consensus.cc:504] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.576030 22044 leader_election.cc:288] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b449eeca71242c88f470d1d8facc63e (127.7.252.2:33745), 16c8774bc7bd417b9f0d3e9a6a53dfba (127.7.252.1:33623)
I20260807 00:37:35.580765 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.576502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:45985 (local address 127.7.252.1:33623)
0807 00:37:35.576549 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.576551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.577178 (+ 627us) server_negotiation.cc:407] Connection header received
0807 00:37:35.577289 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.577290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.577303 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.577333 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:35.577575 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.578303 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.579832 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.580352 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.580398 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.580409 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.580635 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.580675 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:37:35.581256 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.576281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:33623 (local address 127.7.252.3:45985)
0807 00:37:35.577106 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.577117 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:35.577209 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:35.577403 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:35.577404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:35.577406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:35.577501 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.577503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.578425 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.578426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.579708 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.579722 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.580493 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.580494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.580560 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.580564 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:35.581106 (+ 542us) client_negotiation.cc:240] Negotiation successful
0807 00:37:35.581153 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":106,"threads_started":1}
I20260807 00:37:35.581764 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1a3061bdbb4e7e94d60932a7682613" candidate_uuid: "acd24e53eaad4160b4c34030ce548242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" is_pre_election: true
I20260807 00:37:35.581950 21673 raft_consensus.cc:2454] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acd24e53eaad4160b4c34030ce548242 in term 0.
I20260807 00:37:35.582312 21885 leader_election.cc:302] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c8774bc7bd417b9f0d3e9a6a53dfba, acd24e53eaad4160b4c34030ce548242; no voters:
I20260807 00:37:35.582451 22044 raft_consensus.cc:2781] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:37:35.582502 22044 raft_consensus.cc:482] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:37:35.582523 22044 raft_consensus.cc:3037] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:35.583539 22044 raft_consensus.cc:504] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.583690 22044 leader_election.cc:288] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [CANDIDATE]: Term 1 election: Requested vote from peers 9b449eeca71242c88f470d1d8facc63e (127.7.252.2:33745), 16c8774bc7bd417b9f0d3e9a6a53dfba (127.7.252.1:33623)
I20260807 00:37:35.584090 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1a3061bdbb4e7e94d60932a7682613" candidate_uuid: "acd24e53eaad4160b4c34030ce548242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba"
I20260807 00:37:35.584177 21673 raft_consensus.cc:3037] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:35.585268 21673 raft_consensus.cc:2454] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acd24e53eaad4160b4c34030ce548242 in term 1.
I20260807 00:37:35.585573 21885 leader_election.cc:302] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c8774bc7bd417b9f0d3e9a6a53dfba, acd24e53eaad4160b4c34030ce548242; no voters:
I20260807 00:37:35.585707 22044 raft_consensus.cc:2781] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:35.585882 22044 raft_consensus.cc:686] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 1 LEADER]: Becoming Leader. State: Replica: acd24e53eaad4160b4c34030ce548242, State: Running, Role: LEADER
I20260807 00:37:35.585978 22044 consensus_queue.cc:237] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } }
I20260807 00:37:35.586962 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.576836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:54983 (local address 127.7.252.2:33745)
0807 00:37:35.576876 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.576878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.579565 (+ 2687us) server_negotiation.cc:407] Connection header received
0807 00:37:35.579697 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.579699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.579729 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.579765 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:35.580040 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.580829 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.584885 (+ 4056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.585541 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.585600 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.585612 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.586753 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.586818 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:37:35.587435 21515 catalog_manager.cc:5495] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 reported cstate change: term changed from 0 to 1, leader changed from <none> to acd24e53eaad4160b4c34030ce548242 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "acd24e53eaad4160b4c34030ce548242" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acd24e53eaad4160b4c34030ce548242" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 38397 } health_report { overall_health: HEALTHY } } }
I20260807 00:37:35.588055 22045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.576661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:33745 (local address 127.7.252.3:54983)
0807 00:37:35.579465 (+ 2804us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.579480 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:35.579603 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:35.579846 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:35.579847 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:35.579851 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:35.579944 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.579946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.583465 (+ 3519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.583466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.584745 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:35.584750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.585688 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.585689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:35.585783 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.585787 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:35.587920 (+ 2133us) client_negotiation.cc:240] Negotiation successful
0807 00:37:35.587972 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2777,"thread_start_us":77,"threads_started":1}
I20260807 00:37:35.588547 21812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1a3061bdbb4e7e94d60932a7682613" candidate_uuid: "acd24e53eaad4160b4c34030ce548242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b449eeca71242c88f470d1d8facc63e" is_pre_election: true
I20260807 00:37:35.588758 21812 raft_consensus.cc:2454] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acd24e53eaad4160b4c34030ce548242 in term 0.
I20260807 00:37:35.588912 21811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1a3061bdbb4e7e94d60932a7682613" candidate_uuid: "acd24e53eaad4160b4c34030ce548242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b449eeca71242c88f470d1d8facc63e"
I20260807 00:37:35.588994 21811 raft_consensus.cc:3037] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:35.589972 21811 raft_consensus.cc:2454] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acd24e53eaad4160b4c34030ce548242 in term 1.
W20260807 00:37:35.594043 21722 tablet.cc:2369] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:37:35.605746 22033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.599098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.7.252.3:38397)
0807 00:37:35.599154 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:35.599156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:35.599166 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:37:35.599212 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:35.599213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:35.599241 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:35.599351 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:37:35.599527 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.600249 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.601503 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:35.601798 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:35.601873 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:35.602625 (+ 752us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:37:35.603522 (+ 897us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:37:35.603644 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:35.605607 (+ 1963us) server_negotiation.cc:299] Negotiation successful
0807 00:37:35.605641 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 07 00:37:35 dist-test-slave-csg5 krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063054, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for HTTP/127.7.252.20@KRBTEST.COM
I20260807 00:37:35.615149 21811 raft_consensus.cc:1261] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 1 FOLLOWER]: Refusing update from remote peer acd24e53eaad4160b4c34030ce548242: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:35.615382 21673 raft_consensus.cc:1261] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 1 FOLLOWER]: Refusing update from remote peer acd24e53eaad4160b4c34030ce548242: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:35.615626 22047 consensus_queue.cc:1035] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b449eeca71242c88f470d1d8facc63e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:35.616339 22047 consensus_queue.cc:1035] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16c8774bc7bd417b9f0d3e9a6a53dfba" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:35.622951 22051 mvcc.cc:205] Tried to move back new op lower bound from 7315714275795775488 to 7315714275680714752. Current Snapshot: MvccSnapshot[applied={T|T < 7315714275795775488}]
I20260807 00:37:35.623142 22052 mvcc.cc:205] Tried to move back new op lower bound from 7315714275795775488 to 7315714275680714752. Current Snapshot: MvccSnapshot[applied={T|T < 7315714275795775488}]
I20260807 00:37:35.629602 22054 mvcc.cc:205] Tried to move back new op lower bound from 7315714275795775488 to 7315714275680714752. Current Snapshot: MvccSnapshot[applied={T|T < 7315714275795775488}]
I20260807 00:37:35.630771 21515 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:37:35.630892 21515 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:37:35.632074 21515 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5895239a223e410da793f87ca8d8fdb6: Sending DeleteTablet for 3 replicas of tablet ce1a3061bdbb4e7e94d60932a7682613
I20260807 00:37:35.632583 21792 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1a3061bdbb4e7e94d60932a7682613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:35 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:55024
I20260807 00:37:35.632617 21653 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1a3061bdbb4e7e94d60932a7682613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:35 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:52104
I20260807 00:37:35.632943 22063 tablet_replica.cc:330] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba: stopping tablet replica
I20260807 00:37:35.632926 21917 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1a3061bdbb4e7e94d60932a7682613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:35 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:42344
I20260807 00:37:35.633098 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21556
I20260807 00:37:35.633208 22063 raft_consensus.cc:2229] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:37:35.633319 22063 raft_consensus.cc:2258] T ce1a3061bdbb4e7e94d60932a7682613 P 16c8774bc7bd417b9f0d3e9a6a53dfba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:35.634415 22061 tablet_replica.cc:330] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: stopping tablet replica
I20260807 00:37:35.634573 22061 raft_consensus.cc:2229] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:37:35.634703 22061 raft_consensus.cc:2258] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:35.634923 22064 tablet_replica.cc:330] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: stopping tablet replica
I20260807 00:37:35.635059 22064 raft_consensus.cc:2229] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:37:35.635239 22064 raft_consensus.cc:2258] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:35.636097 22064 ts_tablet_manager.cc:1905] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:35.643743 22064 ts_tablet_manager.cc:1918] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:35.643952 22064 log.cc:1196] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/ce1a3061bdbb4e7e94d60932a7682613
I20260807 00:37:35.644359 22064 ts_tablet_manager.cc:1939] T ce1a3061bdbb4e7e94d60932a7682613 P acd24e53eaad4160b4c34030ce548242: Deleting consensus metadata
I20260807 00:37:35.645254 22061 ts_tablet_manager.cc:1905] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 00:37:35.646617 21502 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:33623 (error 108)
I20260807 00:37:35.647645 22029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.647505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:33623 (local address 127.0.0.1:52110)
0807 00:37:35.647565 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.647605 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:33623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 00:37:35.647830 21502 catalog_manager.cc:4584] TS 16c8774bc7bd417b9f0d3e9a6a53dfba (127.7.252.1:33623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce1a3061bdbb4e7e94d60932a7682613: Network error: Client connection negotiation failed: client connection to 127.7.252.1:33623: connect: Connection refused (error 111)
I20260807 00:37:35.647990 22061 ts_tablet_manager.cc:1918] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:35.648066 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21726
I20260807 00:37:35.648104 22061 log.cc:1196] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/ce1a3061bdbb4e7e94d60932a7682613
I20260807 00:37:35.648433 22061 ts_tablet_manager.cc:1939] T ce1a3061bdbb4e7e94d60932a7682613 P 9b449eeca71242c88f470d1d8facc63e: Deleting consensus metadata
I20260807 00:37:35.655635 21503 catalog_manager.cc:4841] TS acd24e53eaad4160b4c34030ce548242 (127.7.252.3:38397): tablet ce1a3061bdbb4e7e94d60932a7682613 (table test-table [id=3b6ee6bee0c9461fae5ed7123f511951]) successfully deleted
I20260807 00:37:35.672643 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21865
I20260807 00:37:35.672750 22029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:35.672609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:33745 (local address 127.0.0.1:55034)
0807 00:37:35.672673 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:35.672703 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.2:33745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 00:37:35.688052 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 21483
I20260807 00:37:35.697295 8176 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 00:37:36.053045 8176 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 00:37:36.053182 8176 mini_ranger.cc:66] Stopping Ranger...
I20260807 00:37:36.398777 8176 mini_ranger.cc:68] Stopped Ranger
2026-08-07 00:37:36.399 UTC [20505] LOG: received smart shutdown request
2026-08-07 00:37:36.404 UTC [20505] LOG: background worker "logical replication launcher" (PID 20515) exited with exit code 1
2026-08-07 00:37:36.404 UTC [20509] LOG: shutting down
2026-08-07 00:37:36.605 UTC [20505] LOG: database system is shut down
2026-08-07T00:37:36Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54770 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:37:36 dist-test-slave-csg5 krb5kdc[22075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:37:36 dist-test-slave-csg5 krb5kdc[22075](info): set up 2 sockets
Aug 07 00:37:36 dist-test-slave-csg5 krb5kdc[22075](info): commencing operation
krb5kdc: starting...
W20260807 00:37:37.836277 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:37:37 dist-test-slave-csg5 krb5kdc[22075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:37:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:37:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:37:37.979774 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41975
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41975,127.7.252.61:32943,127.7.252.60:43627
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:38.066179 22088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:38.066448 22088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:38.066493 22088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:38.067767 22088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:38.068029 22088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:38.068094 22088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:38.068121 22088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:38.068150 22088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:38.070040 22088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41975,127.7.252.61:32943,127.7.252.60:43627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:38.070360 22088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:38.070641 22088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:37:38.076014 22088 server_base.cc:1034] running on GCE node
W20260807 00:37:38.075961 22096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:38.075958 22093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:38.075956 22094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:38.076568 22088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:38.076941 22088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:38.078137 22088 hybrid_clock.cc:648] HybridClock initialized: now 1786063058078116 us; error 42 us; skew 500 ppm
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:38.081292 22088 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:38.081776 22088 webserver.cc:460] Webserver started at http://127.7.252.62:42695/ using document root <none> and password file <none>
I20260807 00:37:38.082036 22088 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:38.082104 22088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:38.082252 22088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:38.083488 22088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "2eeb80c7841a495191e546c59b140871"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "234d40b970170a21fb54b418fb9a11d0"
server_key_iv: "1dbab17812c5703dbf7b9c8697c2883d"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.083877 22088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "2eeb80c7841a495191e546c59b140871"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "234d40b970170a21fb54b418fb9a11d0"
server_key_iv: "1dbab17812c5703dbf7b9c8697c2883d"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.085357 22088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:38.086228 22104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:38.086429 22088 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:38.086541 22088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "2eeb80c7841a495191e546c59b140871"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "234d40b970170a21fb54b418fb9a11d0"
server_key_iv: "1dbab17812c5703dbf7b9c8697c2883d"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.086618 22088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:38.104040 22088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:38.106187 22088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:38.106371 22088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:38.110504 22088 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41975
I20260807 00:37:38.110594 22163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41975 every 8 connection(s)
I20260807 00:37:38.110986 22088 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:38.111918 22164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:38.113526 22164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:37:38.115984 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22088
I20260807 00:37:38.116091 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:37:38.116307 8176 external_mini_cluster.cc:1428] Setting key 09676a935a3d200bd17e9e32d1b03bfa
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:38.125779 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.114207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41975 (local address 127.0.0.1:39454)
0807 00:37:38.114438 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.114478 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.114981 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.115289 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.115292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.115574 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.115789 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.115796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.117145 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.117146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.118264 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.118267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.119108 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.119109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.119171 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.119803 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.119812 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.121311 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.123790 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.123797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.123799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.124015 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.124322 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.124322 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.124323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.124421 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.124989 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.125012 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.125087 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.125203 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.125589 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":145,"thread_start_us":106,"threads_started":1}
I20260807 00:37:38.125782 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.114278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39454 (local address 127.7.252.62:41975)
0807 00:37:38.114847 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.114851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.114884 (+ 33us) server_negotiation.cc:407] Connection header received
0807 00:37:38.115149 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.115151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.115172 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.115264 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.115919 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.117037 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.118358 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.119010 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.119139 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.121412 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.121422 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.121423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.121432 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.123672 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.124105 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.124108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.124109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.124237 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.124498 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.124499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.124499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.124860 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.124968 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.125278 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.125489 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":519,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for kudu/127.7.252.61@KRBTEST.COM; defaulting to no policy
I20260807 00:37:38.126850 22164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:37:38.127305 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.127124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52614)
0807 00:37:38.127201 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.127276 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 00:37:38.127575 22105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
I20260807 00:37:38.128151 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.128049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52622)
0807 00:37:38.128100 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.128130 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 00:37:38.128391 22164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:32943: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab.
Entry for principal kudu/127.7.252.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab.
I20260807 00:37:38.150501 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:32943
--webserver_interface=127.7.252.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab
--principal=kudu/127.7.252.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41975,127.7.252.61:32943,127.7.252.60:43627
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:38.177677 22164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } attempt: 1
I20260807 00:37:38.178283 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.178136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52630)
0807 00:37:38.178206 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.178250 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 00:37:38.178762 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.178620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52642)
0807 00:37:38.178706 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.178739 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 00:37:38.178871 22164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:32943: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
W20260807 00:37:38.241597 22173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:38.241904 22173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:38.241954 22173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:38.243388 22173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:38.243471 22173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:38.243498 22173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:38.243523 22173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:38.243557 22173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:38.245399 22173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41975,127.7.252.61:32943,127.7.252.60:43627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab
--principal=kudu/127.7.252.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:32943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.252.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:38.245783 22173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:38.246075 22173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:37:38.247051 22164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } attempt: 2
I20260807 00:37:38.247681 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.247493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52656)
0807 00:37:38.247582 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.247639 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 00:37:38.248138 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.248028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52668)
0807 00:37:38.248087 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.248118 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 00:37:38.248256 22164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:32943: Network error: Client connection negotiation failed: client connection to 127.7.252.61:32943: connect: Connection refused (error 111)
W20260807 00:37:38.251570 22181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:38.251672 22178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:38.251585 22179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:38.251904 22173 server_base.cc:1034] running on GCE node
I20260807 00:37:38.252140 22173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:38.252450 22173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:38.253635 22173 hybrid_clock.cc:648] HybridClock initialized: now 1786063058253618 us; error 30 us; skew 500 ppm
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:38.256630 22173 init.cc:377] Logged in from keytab as kudu/127.7.252.61@KRBTEST.COM (short username kudu)
I20260807 00:37:38.257089 22173 webserver.cc:460] Webserver started at http://127.7.252.61:33131/ using document root <none> and password file <none>
I20260807 00:37:38.257324 22173 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:38.257373 22173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:38.257478 22173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:38.259045 22173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data/instance:
uuid: "56e5937365e44f2e89da8694de8405bc"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "934ec1284e8d9f8954c9e004ea656fb8"
server_key_iv: "ee37ca82659171b9cf072bae1b1bcb90"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.259492 22173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal/instance:
uuid: "56e5937365e44f2e89da8694de8405bc"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "934ec1284e8d9f8954c9e004ea656fb8"
server_key_iv: "ee37ca82659171b9cf072bae1b1bcb90"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.260950 22173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:38.261773 22189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:38.261991 22173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:38.262072 22173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal
uuid: "56e5937365e44f2e89da8694de8405bc"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "934ec1284e8d9f8954c9e004ea656fb8"
server_key_iv: "ee37ca82659171b9cf072bae1b1bcb90"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.262131 22173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:38.281088 22173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:38.283764 22173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:38.283905 22173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:38.288193 22173 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.61:32943
I20260807 00:37:38.288275 22245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.61:32943 every 8 connection(s)
I20260807 00:37:38.288628 22173 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
I20260807 00:37:38.289862 22246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:38.292048 22246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:37:38.297168 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22173
I20260807 00:37:38.297314 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-1/wal/instance
I20260807 00:37:38.297538 8176 external_mini_cluster.cc:1428] Setting key b964eb0264a7b5a37ee3ca2ec04f4592
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:38.304060 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.292877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41975 (local address 127.0.0.1:39466)
0807 00:37:38.293096 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.293151 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.293640 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.294127 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.294132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.294470 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.294831 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.294844 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.295765 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.295767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.296871 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.296874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.297456 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.297457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.297622 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.298323 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.298332 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.300296 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.302457 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.302468 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.302470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.302823 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.303067 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.303067 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.303068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.303179 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.303512 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.303518 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.303645 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.303748 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.303884 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":132,"threads_started":1}
I20260807 00:37:38.304069 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.292922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39466 (local address 127.7.252.62:41975)
0807 00:37:38.293006 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.293009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.293264 (+ 255us) server_negotiation.cc:407] Connection header received
0807 00:37:38.293752 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.293754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.293767 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.293840 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.294978 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.295639 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.296987 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.297335 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.297435 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.300459 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.300460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.300461 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.300471 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.302343 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.302914 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.302915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.302916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.302988 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.303259 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.303260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.303261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.303436 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.303508 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.303815 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.303928 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:37:38.304869 22246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.252.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.60@KRBTEST.COM" created.
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:37:38.313855 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.305175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52678)
0807 00:37:38.305341 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.305350 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.305409 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.305607 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.305608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.305782 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.305832 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.305834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.306763 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.306764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.307329 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.307331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.307877 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.307878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.307950 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.308417 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.308422 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.310539 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.312726 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.312727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.312727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.312902 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.313155 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.313156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.313156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.313230 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.313606 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.313606 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.313647 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.313704 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.313783 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260807 00:37:38.314121 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.305257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52678 (local address 127.7.252.61:32943)
0807 00:37:38.305462 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.305468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.305492 (+ 24us) server_negotiation.cc:407] Connection header received
0807 00:37:38.305511 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.305513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.305529 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.305607 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.305914 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.306620 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.307420 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.307745 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.307877 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.310645 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.310673 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.310674 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.310680 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.312614 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.312985 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.312989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.312989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.313080 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.313308 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.313309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.313310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.313532 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.313624 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.313764 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.313861 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":118,"threads_started":1}
I20260807 00:37:38.314878 22246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:37:38.315277 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.315162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48226)
0807 00:37:38.315210 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.315258 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 00:37:38.315439 22192 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
I20260807 00:37:38.315888 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.315795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48242)
0807 00:37:38.315841 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.315865 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 00:37:38.316015 22246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:43627: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab.
Entry for principal kudu/127.7.252.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab.
I20260807 00:37:38.330538 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:43627
--webserver_interface=127.7.252.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab
--principal=kudu/127.7.252.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41975,127.7.252.61:32943,127.7.252.60:43627
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:38.339409 22164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } attempt: 3
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:37:38.348091 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.339988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52692 (local address 127.7.252.61:32943)
0807 00:37:38.340075 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.340078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.340092 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:37:38.340123 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.340124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.340137 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.340228 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.340866 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.341712 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.342424 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.342777 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.342848 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.345029 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.345031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.345031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.345039 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.346798 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.347155 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.347156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.347156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.347231 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.347468 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.347470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.347470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.347635 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.347718 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.347891 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.347982 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 00:37:38.348109 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.339862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52692)
0807 00:37:38.339957 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.339973 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.340048 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.340258 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.340260 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.340479 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.340755 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.340759 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.341807 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.341808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.342334 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.342336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.342869 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.342870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.342951 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.343464 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.343469 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.344935 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.346896 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.346897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.346897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.347081 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.347321 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.347322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.347323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.347392 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.347730 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.347731 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.347780 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.347846 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.348002 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 00:37:38.348531 22164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:37:38.349196 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.349076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48252)
0807 00:37:38.349127 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.349157 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 00:37:38.349588 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.349477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48256)
0807 00:37:38.349528 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.349563 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260807 00:37:38.349679 22164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:43627: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
I20260807 00:37:38.365252 22246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } attempt: 1
I20260807 00:37:38.365868 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.365745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48266)
0807 00:37:38.365795 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.365838 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 00:37:38.366618 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.366462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48270)
0807 00:37:38.366571 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.366599 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260807 00:37:38.366757 22246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:43627: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
I20260807 00:37:38.380836 22164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } attempt: 1
I20260807 00:37:38.381420 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.381246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48278)
0807 00:37:38.381315 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.381373 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 00:37:38.381876 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.381772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48292)
0807 00:37:38.381821 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.381854 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 00:37:38.381980 22164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:43627: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
W20260807 00:37:38.424124 22253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:38.424377 22253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:38.424403 22253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:38.425698 22253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:38.425758 22253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:38.425773 22253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:38.425786 22253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:38.425798 22253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:38.427522 22253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41975,127.7.252.61:32943,127.7.252.60:43627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab
--principal=kudu/127.7.252.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:43627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.252.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:38.427832 22253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:38.428095 22253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:38.433740 22261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:38.433760 22258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:38.433866 22253 server_base.cc:1034] running on GCE node
W20260807 00:37:38.433749 22259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:38.434310 22253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:38.434697 22253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:38.434898 22246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } attempt: 2
I20260807 00:37:38.435482 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.435268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48304)
0807 00:37:38.435404 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.435443 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260807 00:37:38.435851 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.435759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48316)
0807 00:37:38.435801 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.435831 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 00:37:38.435850 22253 hybrid_clock.cc:648] HybridClock initialized: now 1786063058435849 us; error 61 us; skew 500 ppm
W20260807 00:37:38.435943 22246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:43627: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:38.438639 22253 init.cc:377] Logged in from keytab as kudu/127.7.252.60@KRBTEST.COM (short username kudu)
I20260807 00:37:38.439194 22253 webserver.cc:460] Webserver started at http://127.7.252.60:33545/ using document root <none> and password file <none>
I20260807 00:37:38.439410 22253 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:38.439452 22253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:38.439551 22253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:38.441033 22253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data/instance:
uuid: "9ea434295dfd4b519306e2526f350e5d"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "b7e80e05dd975b7147bb3fc3b11f98cd"
server_key_iv: "91303467d15f1527b019afa0e91cbec0"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.441531 22253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal/instance:
uuid: "9ea434295dfd4b519306e2526f350e5d"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "b7e80e05dd975b7147bb3fc3b11f98cd"
server_key_iv: "91303467d15f1527b019afa0e91cbec0"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.443687 22253 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 00:37:38.444598 22268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:38.444811 22253 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:38.444904 22253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal
uuid: "9ea434295dfd4b519306e2526f350e5d"
format_stamp: "Formatted at 2026-08-07 00:37:38 on dist-test-slave-csg5"
server_key: "b7e80e05dd975b7147bb3fc3b11f98cd"
server_key_iv: "91303467d15f1527b019afa0e91cbec0"
server_key_version: "encryptionkey@0"
I20260807 00:37:38.444984 22253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:38.457124 22164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } attempt: 2
I20260807 00:37:38.457701 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.457550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48322)
0807 00:37:38.457619 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.457665 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 00:37:38.458050 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.457955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48324)
0807 00:37:38.458001 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.458032 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 00:37:38.458237 22164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:43627: Network error: Client connection negotiation failed: client connection to 127.7.252.60:43627: connect: Connection refused (error 111)
I20260807 00:37:38.469040 22253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:38.471431 22253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:38.471632 22253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:38.476176 22253 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.60:43627
I20260807 00:37:38.476320 22323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.60:43627 every 8 connection(s)
I20260807 00:37:38.476648 22253 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
I20260807 00:37:38.476930 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22253
I20260807 00:37:38.477077 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786062890064039-8176-0/minicluster-data/master-2/wal/instance
I20260807 00:37:38.477370 8176 external_mini_cluster.cc:1428] Setting key 9dc2242ff7bd715b6d9115e99b35b2e7
I20260807 00:37:38.477695 22324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:38.479961 22324 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:38.489779 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.477923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48338 (local address 127.7.252.60:43627)
0807 00:37:38.478132 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.478148 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.478176 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:37:38.478899 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.478907 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.478962 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.479116 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.479839 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.480923 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.481892 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.482426 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.482536 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.485567 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.485577 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.485578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.485586 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.487606 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.488274 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.488278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.488278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.488363 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.488592 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.488592 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.488593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.488960 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.489116 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.489401 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.489548 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
I20260807 00:37:38.490025 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.480701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39476 (local address 127.7.252.62:41975)
0807 00:37:38.480773 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.480775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.480996 (+ 221us) server_negotiation.cc:407] Connection header received
0807 00:37:38.481052 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.481053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.481065 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.481135 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.481620 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.482187 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.483367 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.483695 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.483795 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.486795 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.486797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.486797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.486806 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.488515 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.489077 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.489078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.489079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.489169 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.489393 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.489394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.489394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.489538 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.489622 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.489808 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.489930 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 00:37:38.490043 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.480595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41975 (local address 127.0.0.1:39476)
0807 00:37:38.480852 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.480898 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.480989 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.481201 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.481203 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.481474 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.481537 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.481539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.482341 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.482342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.483276 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.483279 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.483835 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.483836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.483908 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.484593 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.484608 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.486616 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.488592 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.488599 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.488601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.488991 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.489244 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.489245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.489245 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.489318 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.489628 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.489636 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.489693 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.489779 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.489936 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":127,"threads_started":1}
I20260807 00:37:38.490607 22324 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:38.498641 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.490970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:32943 (local address 127.0.0.1:52702)
0807 00:37:38.491067 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.491078 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.491116 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.491299 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.491300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.491458 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.491506 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.491508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.492196 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.492197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.492839 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.492841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.493198 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.493199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.493268 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.493813 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.493818 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.495358 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.497422 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.497423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.497424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.497747 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.497979 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.497980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.497980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.498057 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.498304 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.498305 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.498371 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.498442 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.498546 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 00:37:38.498718 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.491084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52702 (local address 127.7.252.61:32943)
0807 00:37:38.491133 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.491134 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.491143 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:37:38.491178 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.491179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.491189 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.491244 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.491597 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.492113 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.492924 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.493117 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.493182 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.495460 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.495462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.495462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.495471 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.497238 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.497848 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.497849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.497849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.497905 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.498126 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.498127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.498127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.498238 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.498441 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.498494 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.498580 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:37:38.499645 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.490760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39488 (local address 127.7.252.62:41975)
0807 00:37:38.490799 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.490801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.490913 (+ 112us) server_negotiation.cc:407] Connection header received
0807 00:37:38.490937 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.490938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.490949 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.490997 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.491717 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.492413 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.493311 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.493485 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.493539 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.496097 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.496098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.496099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.496106 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.498342 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.498882 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.498884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.498884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.498963 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.499196 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.499197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.499198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.499334 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.499484 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.499517 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.499581 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:37:38.499783 22324 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:37:38.507097 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.500104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48340)
0807 00:37:38.500143 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.500155 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.500201 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.500482 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.500483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.500642 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.500675 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.500676 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.501379 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.501380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.501904 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.501906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.502308 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.502308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.502359 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.502880 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.502885 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.504284 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.505972 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.505973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.505973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.506153 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.506362 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.506363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.506363 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.506425 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.506693 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.506694 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.506739 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.506827 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.506939 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260807 00:37:38.507148 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.500157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48340 (local address 127.7.252.60:43627)
0807 00:37:38.500376 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.500377 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.500384 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:37:38.500400 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.500400 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.500408 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.500480 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.500761 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.501277 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.501997 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.502222 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.502308 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.504385 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.504387 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.504387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.504395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.505866 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.506226 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.506227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.506227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.506285 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.506487 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.506489 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.506489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.506606 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.506729 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.506849 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.507007 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":202}
I20260807 00:37:38.507900 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.500402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52716 (local address 127.7.252.61:32943)
0807 00:37:38.500439 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.500441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.500449 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:37:38.500471 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.500472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.500481 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.500535 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.501035 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.501497 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.502136 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.502343 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.502413 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.505004 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.505006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.505006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.505013 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.506459 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.506877 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.506878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.506879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.506935 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.507125 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.507126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.507126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.507282 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.507514 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.507710 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.507790 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:37:38.508929 22324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: Bootstrap starting.
I20260807 00:37:38.509754 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:37:38.510030 22324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:38.510357 22324 log.cc:824] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:38.511456 22324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: No bootstrap required, opened a new log
I20260807 00:37:38.513425 22324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.513616 22324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:38.513672 22324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea434295dfd4b519306e2526f350e5d, State: Initialized, Role: FOLLOWER
I20260807 00:37:38.513806 22324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.514163 22324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:38.514122 22337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.514345 22337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:37:38.517417 22349 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:37:38.517479 22349 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:37:38.519829 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.511543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39494 (local address 127.7.252.62:41975)
0807 00:37:38.511629 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.511631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.511915 (+ 284us) server_negotiation.cc:407] Connection header received
0807 00:37:38.511941 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.511942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.511953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.512007 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.512645 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.513110 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.514088 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.514387 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.514459 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.516164 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.516165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.516165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.516174 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.518438 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.518905 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.518906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.518907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.518970 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.519173 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.519174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.519174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.519319 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.519429 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.519594 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.519702 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 00:37:38.517653 22253 master_runner.cc:186] Error getting master registration for 127.7.252.62:41975: OK, instance_id { permanent_uuid: "2eeb80c7841a495191e546c59b140871" instance_seqno: 1786063058109307 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 00:37:38.521170 22253 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 00:37:38.522779 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.515036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48344 (local address 127.7.252.60:43627)
0807 00:37:38.515135 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.515137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.515317 (+ 180us) server_negotiation.cc:407] Connection header received
0807 00:37:38.515380 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.515381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.515393 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.515447 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.516124 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.516850 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.518147 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.518380 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.518473 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.519840 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.519841 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.519841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.519848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.521218 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.521570 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.521571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.521571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.521631 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.522093 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.522094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.522094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.522265 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.522374 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.522532 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.522615 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 00:37:38.524168 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.511486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.7.252.61:32943)
0807 00:37:38.511593 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.511596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.511662 (+ 66us) server_negotiation.cc:407] Connection header received
0807 00:37:38.511801 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.511802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.511813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.511882 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.512606 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.513516 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.514535 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.514886 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.514953 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.516432 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.516433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.516434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.516441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.521759 (+ 5318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.522071 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.522072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.522073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.522138 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.522395 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.522396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.522396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.522546 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.523928 (+ 1382us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.523977 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.524076 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 00:37:38.527109 22246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } attempt: 3
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:37:38.534948 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.527458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48356)
0807 00:37:38.527540 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.527555 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.527611 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.527777 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.527778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.527934 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.527983 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.527985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.528935 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.528936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.529544 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.529546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.530015 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.530016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.530060 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.530617 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.530623 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.531926 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.533906 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.533907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.533907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.534089 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.534315 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.534315 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.534316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.534370 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.534640 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.534641 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.534731 (+ 90us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.534788 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.534879 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 00:37:38.535007 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.527580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48356 (local address 127.7.252.60:43627)
0807 00:37:38.527649 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.527652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.527662 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:37:38.527685 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.527686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.527701 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.527765 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.528060 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.528842 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.529628 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.529929 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.530000 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.532013 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.532015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.532015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.532023 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.533804 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.534159 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.534160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.534160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.534239 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.534433 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.534434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.534435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.534576 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.534645 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.534831 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.534913 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 00:37:38.536949 22246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: Bootstrap starting.
I20260807 00:37:38.537779 22246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:38.538100 22246 log.cc:824] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:38.539083 22246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: No bootstrap required, opened a new log
I20260807 00:37:38.541267 22246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.541438 22246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:38.541477 22246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e5937365e44f2e89da8694de8405bc, State: Initialized, Role: FOLLOWER
I20260807 00:37:38.541643 22246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.542021 22246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:38.542303 22352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.542506 22352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:37:38.544179 22363 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:37:38.544302 22363 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:37:38.544325 22173 master_runner.cc:186] Error getting master registration for 127.7.252.62:41975: OK, instance_id { permanent_uuid: "2eeb80c7841a495191e546c59b140871" instance_seqno: 1786063058109307 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 00:37:38.547322 22173 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 00:37:38.557413 22164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } attempt: 3
Aug 07 00:37:38 dist-test-slave-csg5 krb5kdc[22075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063058, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:37:38.566915 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.557920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48358 (local address 127.7.252.60:43627)
0807 00:37:38.557983 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:38.557985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:38.557996 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:37:38.558058 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:38.558059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:38.558070 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:38.558144 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:38.558556 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.559335 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.560398 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.560720 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.560797 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.563772 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:38.563773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:38.563774 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:38.563783 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:38.565533 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.565990 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.565991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.565992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.566063 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:38.566277 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:38.566277 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:38.566278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:38.566440 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:38.566515 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:38.566726 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 00:37:38.566814 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 00:37:38.566915 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:38.557860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:43627 (local address 127.0.0.1:48358)
0807 00:37:38.557939 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:38.557951 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:38.557996 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:38.558163 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:38.558164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:38.558383 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:38.558466 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.558468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.559437 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.559438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.560281 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:38.560284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:38.560806 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:38.560808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:38.560874 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:38.561422 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:38.561427 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:38.563672 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:38.565640 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.565642 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.565642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.565898 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.566135 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:38.566136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:38.566136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:38.566208 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:38.566516 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:38.566517 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:38.566573 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 00:37:38.566683 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 00:37:38.566798 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 00:37:38.569253 22164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: Bootstrap starting.
I20260807 00:37:38.570060 22164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:38.570375 22164 log.cc:824] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:38.571424 22164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: No bootstrap required, opened a new log
I20260807 00:37:38.574460 22164 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.574622 22164 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:38.574700 22164 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eeb80c7841a495191e546c59b140871, State: Initialized, Role: FOLLOWER
I20260807 00:37:38.574844 22164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.575222 22164 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:38.575167 22366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.575374 22366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:37:38.577136 22377 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:37:38.577252 22377 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:37:38.579557 22088 master_runner.cc:263] No leader master found from master 2eeb80c7841a495191e546c59b140871
I20260807 00:37:38.579620 22088 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 00:37:38.607446 22110 tablet.cc:2369] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:37:38.722369 22275 tablet.cc:2369] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:37:38.784801 22195 tablet.cc:2369] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:37:38.826290 22352 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:38.826434 22352 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.826815 22352 leader_election.cc:288] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2eeb80c7841a495191e546c59b140871 (127.7.252.62:41975), 9ea434295dfd4b519306e2526f350e5d (127.7.252.60:43627)
I20260807 00:37:38.827178 22296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56e5937365e44f2e89da8694de8405bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea434295dfd4b519306e2526f350e5d" is_pre_election: true
I20260807 00:37:38.827221 22135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56e5937365e44f2e89da8694de8405bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2eeb80c7841a495191e546c59b140871" is_pre_election: true
I20260807 00:37:38.827328 22296 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e5937365e44f2e89da8694de8405bc in term 0.
I20260807 00:37:38.827420 22135 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56e5937365e44f2e89da8694de8405bc in term 0.
I20260807 00:37:38.827593 22192 leader_election.cc:302] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e5937365e44f2e89da8694de8405bc, 9ea434295dfd4b519306e2526f350e5d; no voters:
I20260807 00:37:38.827744 22352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:37:38.827809 22352 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:37:38.827833 22352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:38.828621 22352 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.828822 22352 leader_election.cc:288] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [CANDIDATE]: Term 1 election: Requested vote from peers 2eeb80c7841a495191e546c59b140871 (127.7.252.62:41975), 9ea434295dfd4b519306e2526f350e5d (127.7.252.60:43627)
I20260807 00:37:38.829028 22135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56e5937365e44f2e89da8694de8405bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2eeb80c7841a495191e546c59b140871"
I20260807 00:37:38.829047 22296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56e5937365e44f2e89da8694de8405bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea434295dfd4b519306e2526f350e5d"
I20260807 00:37:38.829145 22296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:38.829152 22135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:38.829983 22296 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e5937365e44f2e89da8694de8405bc in term 1.
I20260807 00:37:38.830124 22135 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56e5937365e44f2e89da8694de8405bc in term 1.
I20260807 00:37:38.830341 22191 leader_election.cc:302] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2eeb80c7841a495191e546c59b140871, 56e5937365e44f2e89da8694de8405bc; no voters:
I20260807 00:37:38.830461 22352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:38.830605 22352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [term 1 LEADER]: Becoming Leader. State: Replica: 56e5937365e44f2e89da8694de8405bc, State: Running, Role: LEADER
I20260807 00:37:38.830729 22352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } }
I20260807 00:37:38.831298 22379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56e5937365e44f2e89da8694de8405bc. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.831399 22379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:38.831620 22381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:38.831842 22381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:37:38.833477 22135 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [term 1 FOLLOWER]: Refusing update from remote peer 56e5937365e44f2e89da8694de8405bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:38.833652 22296 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [term 1 FOLLOWER]: Refusing update from remote peer 56e5937365e44f2e89da8694de8405bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:38.833847 22352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:38.833977 22379 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:38.835362 22366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56e5937365e44f2e89da8694de8405bc. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.835485 22366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:37:38.836376 22337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56e5937365e44f2e89da8694de8405bc. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.836391 22379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.836496 22337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:37:38.836498 22379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:38.836568 22382 mvcc.cc:205] Tried to move back new op lower bound from 7315714288978911232 to 7315714288971300864. Current Snapshot: MvccSnapshot[applied={T|T < 7315714288978911232}]
I20260807 00:37:38.836755 22366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.836869 22366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:37:38.836931 22383 mvcc.cc:205] Tried to move back new op lower bound from 7315714288978911232 to 7315714288971300864. Current Snapshot: MvccSnapshot[applied={T|T < 7315714288978911232 or (T in {7315714288978911232})}]
I20260807 00:37:38.837369 22379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.837425 22381 catalog_manager.cc:1347] Generated new cluster ID: 09a3835170594adbade506dc53c41f01
I20260807 00:37:38.837486 22379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:38.837502 22381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:37:38.837796 22337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "56e5937365e44f2e89da8694de8405bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2eeb80c7841a495191e546c59b140871" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41975 } } peers { permanent_uuid: "56e5937365e44f2e89da8694de8405bc" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 32943 } } peers { permanent_uuid: "9ea434295dfd4b519306e2526f350e5d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 43627 } } }
I20260807 00:37:38.837867 22337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:37:38.846381 22381 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:37:38.847142 22381 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:37:38.855600 22381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56e5937365e44f2e89da8694de8405bc: Generated new TSK 0
I20260807 00:37:38.855835 22381 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:37:39.517937 22349 catalog_manager.cc:1259] Loaded cluster ID: 09a3835170594adbade506dc53c41f01
I20260807 00:37:39.518021 22349 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: loading cluster ID for follower catalog manager: success
I20260807 00:37:39.518958 22349 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: acquiring CA information for follower catalog manager: success
I20260807 00:37:39.519317 22349 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9ea434295dfd4b519306e2526f350e5d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 00:37:39.577754 22377 catalog_manager.cc:1259] Loaded cluster ID: 09a3835170594adbade506dc53c41f01
I20260807 00:37:39.577839 22377 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: loading cluster ID for follower catalog manager: success
I20260807 00:37:39.578807 22377 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: acquiring CA information for follower catalog manager: success
I20260807 00:37:39.579136 22377 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2eeb80c7841a495191e546c59b140871: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 00:37:39.933014 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22088
I20260807 00:37:39.940996 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22173
I20260807 00:37:39.948058 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22253
2026-08-07T00:37:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3210 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:37:40 dist-test-slave-csg5 krb5kdc[22396](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:37:40 dist-test-slave-csg5 krb5kdc[22396](info): set up 2 sockets
Aug 07 00:37:40 dist-test-slave-csg5 krb5kdc[22396](info): commencing operation
krb5kdc: starting...
W20260807 00:37:41.087409 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:37:41 dist-test-slave-csg5 krb5kdc[22396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:37:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:37:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:37:41.231102 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:40607
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:40195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:40607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:41.322578 22409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:41.322914 22409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:41.322968 22409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:41.324240 22409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:41.324317 22409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:41.324342 22409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:41.324360 22409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:41.324398 22409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:41.326136 22409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:40195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:40607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:40607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:41.326457 22409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:41.326730 22409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:37:41.332266 22409 server_base.cc:1034] running on GCE node
W20260807 00:37:41.332175 22414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:41.332168 22418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:41.332175 22415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:41.332767 22409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:41.333122 22409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:41.334322 22409 hybrid_clock.cc:648] HybridClock initialized: now 1786063061334294 us; error 43 us; skew 500 ppm
Aug 07 00:37:41 dist-test-slave-csg5 krb5kdc[22396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063061, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:41.337251 22409 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:41.337779 22409 webserver.cc:460] Webserver started at http://127.7.252.62:35229/ using document root <none> and password file <none>
I20260807 00:37:41.338027 22409 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:41.338093 22409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:41.338251 22409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:41.339407 22409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "d86c603f11334c84b0df097b7ea5ad10"
format_stamp: "Formatted at 2026-08-07 00:37:41 on dist-test-slave-csg5"
server_key: "a8dd880fc3b1044e2f3c99d23efe5e27"
server_key_iv: "f17037223492e2683b9976e49efa03ec"
server_key_version: "encryptionkey@0"
I20260807 00:37:41.339787 22409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "d86c603f11334c84b0df097b7ea5ad10"
format_stamp: "Formatted at 2026-08-07 00:37:41 on dist-test-slave-csg5"
server_key: "a8dd880fc3b1044e2f3c99d23efe5e27"
server_key_iv: "f17037223492e2683b9976e49efa03ec"
server_key_version: "encryptionkey@0"
I20260807 00:37:41.341300 22409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:41.342197 22425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:41.342499 22409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:41.342687 22409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "d86c603f11334c84b0df097b7ea5ad10"
format_stamp: "Formatted at 2026-08-07 00:37:41 on dist-test-slave-csg5"
server_key: "a8dd880fc3b1044e2f3c99d23efe5e27"
server_key_iv: "f17037223492e2683b9976e49efa03ec"
server_key_version: "encryptionkey@0"
I20260807 00:37:41.342779 22409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:41.352597 22409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:41.355942 22409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:41.356161 22409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:41.362133 22409 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:40607
I20260807 00:37:41.362186 22479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:40607 every 8 connection(s)
I20260807 00:37:41.362618 22409 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:41.363915 22480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:41.367800 22480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10: Bootstrap starting.
I20260807 00:37:41.367836 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22409
I20260807 00:37:41.367944 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:37:41.368207 8176 external_mini_cluster.cc:1428] Setting key 82f7a225e99b2e640516b3f814d4740d
I20260807 00:37:41.368508 22480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:41.368868 22480 log.cc:824] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:41.369825 22480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10: No bootstrap required, opened a new log
I20260807 00:37:41.372762 22480 raft_consensus.cc:348] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86c603f11334c84b0df097b7ea5ad10" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40607 } }
I20260807 00:37:41.372982 22480 raft_consensus.cc:374] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:41.373021 22480 raft_consensus.cc:729] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86c603f11334c84b0df097b7ea5ad10, State: Initialized, Role: FOLLOWER
I20260807 00:37:41.373183 22480 consensus_queue.cc:260] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86c603f11334c84b0df097b7ea5ad10" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40607 } }
I20260807 00:37:41.373272 22480 raft_consensus.cc:388] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:37:41.373304 22480 raft_consensus.cc:482] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:37:41.373359 22480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:41.374110 22480 raft_consensus.cc:504] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86c603f11334c84b0df097b7ea5ad10" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40607 } }
I20260807 00:37:41.374207 22480 leader_election.cc:302] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d86c603f11334c84b0df097b7ea5ad10; no voters:
I20260807 00:37:41.374390 22480 leader_election.cc:288] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:37:41.374425 22485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:41.374707 22480 sys_catalog.cc:564] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:41.374728 22485 raft_consensus.cc:686] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [term 1 LEADER]: Becoming Leader. State: Replica: d86c603f11334c84b0df097b7ea5ad10, State: Running, Role: LEADER
I20260807 00:37:41.374840 22485 consensus_queue.cc:237] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86c603f11334c84b0df097b7ea5ad10" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40607 } }
I20260807 00:37:41.375200 22485 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d86c603f11334c84b0df097b7ea5ad10. Latest consensus state: current_term: 1 leader_uuid: "d86c603f11334c84b0df097b7ea5ad10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86c603f11334c84b0df097b7ea5ad10" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40607 } } }
I20260807 00:37:41.375295 22485 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:41.375487 22486 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d86c603f11334c84b0df097b7ea5ad10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86c603f11334c84b0df097b7ea5ad10" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40607 } } }
I20260807 00:37:41.375571 22486 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10 [sys.catalog]: This master's current role is: LEADER
W20260807 00:37:41.376928 22502 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:37:41.377049 22502 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:37:41.377166 22495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:41.377403 22495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 00:37:41 dist-test-slave-csg5 krb5kdc[22396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:41.379164 22495 catalog_manager.cc:1347] Generated new cluster ID: e979167379ce4affa797c85c4378d37b
I20260807 00:37:41.379245 22495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:37:41.382860 22483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:41.368850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37644 (local address 127.7.252.62:40607)
0807 00:37:41.369257 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:41.369269 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:41.369325 (+ 56us) server_negotiation.cc:407] Connection header received
0807 00:37:41.370000 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:41.370010 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:41.370075 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:41.370232 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:41.371219 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:41.372734 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:41.373861 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:41.375190 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:41.375870 (+ 680us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:41.378725 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:41.378730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:41.378730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:41.378744 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:41.380787 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:41.381243 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:41.381248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:41.381249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:41.381422 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:41.381638 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:41.381639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:41.381640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:41.382043 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:41.382208 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:41.382344 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 00:37:41.382545 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":78,"threads_started":1}
I20260807 00:37:41.384608 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:37:41.396411 22495 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:37:41.397061 22495 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:37:41.408742 22495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d86c603f11334c84b0df097b7ea5ad10: Generated new TSK 0
I20260807 00:37:41.408994 22495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:37:41.438865 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22409
2026-08-07T00:37:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1491 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:37:41 dist-test-slave-csg5 krb5kdc[22508](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:37:41 dist-test-slave-csg5 krb5kdc[22508](info): set up 2 sockets
Aug 07 00:37:41 dist-test-slave-csg5 krb5kdc[22508](info): commencing operation
krb5kdc: starting...
W20260807 00:37:42.577381 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:37:42 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:37:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:37:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:37:42.714968 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44809
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44809
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:42.802357 22521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:42.802606 22521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:42.802642 22521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:42.803810 22521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:42.803877 22521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:42.803905 22521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:42.803934 22521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:42.803962 22521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:42.805472 22521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:42.805751 22521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:42.805980 22521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:42.811189 22529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:42.811230 22527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:42.811395 22521 server_base.cc:1034] running on GCE node
W20260807 00:37:42.811223 22526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:42.811697 22521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:42.812001 22521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:42.813149 22521 hybrid_clock.cc:648] HybridClock initialized: now 1786063062813127 us; error 38 us; skew 500 ppm
Aug 07 00:37:42 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063062, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:42.821328 22521 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:42.821806 22521 webserver.cc:460] Webserver started at http://127.7.252.62:41205/ using document root <none> and password file <none>
I20260807 00:37:42.822037 22521 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:42.822084 22521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:42.822229 22521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:42.823431 22521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "9eb3fc501279432281a4ceab79622c09"
format_stamp: "Formatted at 2026-08-07 00:37:42 on dist-test-slave-csg5"
server_key: "de14b1dbfa13cd43008c440a05c2bb72"
server_key_iv: "72ed4656ad435768c066c43b8651df7b"
server_key_version: "encryptionkey@0"
I20260807 00:37:42.823796 22521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "9eb3fc501279432281a4ceab79622c09"
format_stamp: "Formatted at 2026-08-07 00:37:42 on dist-test-slave-csg5"
server_key: "de14b1dbfa13cd43008c440a05c2bb72"
server_key_iv: "72ed4656ad435768c066c43b8651df7b"
server_key_version: "encryptionkey@0"
I20260807 00:37:42.825309 22521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:42.826205 22536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:42.826539 22521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:42.826722 22521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "9eb3fc501279432281a4ceab79622c09"
format_stamp: "Formatted at 2026-08-07 00:37:42 on dist-test-slave-csg5"
server_key: "de14b1dbfa13cd43008c440a05c2bb72"
server_key_iv: "72ed4656ad435768c066c43b8651df7b"
server_key_version: "encryptionkey@0"
I20260807 00:37:42.826814 22521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:42.835795 22521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:42.838081 22521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:42.838246 22521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:42.842741 22521 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44809
I20260807 00:37:42.842792 22589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44809 every 8 connection(s)
I20260807 00:37:42.843168 22521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:42.844269 22591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:42.846638 22591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap starting.
I20260807 00:37:42.847242 22591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:42.847584 22591 log.cc:824] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:42.848415 22591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: No bootstrap required, opened a new log
I20260807 00:37:42.850229 22591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:42.850387 22591 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:42.850412 22591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb3fc501279432281a4ceab79622c09, State: Initialized, Role: FOLLOWER
I20260807 00:37:42.850574 22591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:42.850719 22591 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:37:42.850769 22591 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:37:42.850812 22591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:42.851651 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22521
I20260807 00:37:42.851778 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:37:42.851931 22591 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:42.852029 8176 external_mini_cluster.cc:1428] Setting key f43e9bf1d039e7692aa66e202fe89158
I20260807 00:37:42.852061 22591 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eb3fc501279432281a4ceab79622c09; no voters:
I20260807 00:37:42.852260 22591 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:37:42.852380 22594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:42.852548 22591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:42.852599 22594 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 LEADER]: Becoming Leader. State: Replica: 9eb3fc501279432281a4ceab79622c09, State: Running, Role: LEADER
I20260807 00:37:42.852818 22594 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:42.853302 22596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb3fc501279432281a4ceab79622c09. Latest consensus state: current_term: 1 leader_uuid: "9eb3fc501279432281a4ceab79622c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } } }
I20260807 00:37:42.853295 22595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eb3fc501279432281a4ceab79622c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } } }
I20260807 00:37:42.853401 22596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:42.853410 22595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:42.853601 22605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:42.854177 22605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:37:42.855949 22605 catalog_manager.cc:1347] Generated new cluster ID: 8677e5cb0f52474da5e1401824b5baf9
I20260807 00:37:42.856036 22605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:37:42 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:42.863847 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:42.852700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33126 (local address 127.7.252.62:44809)
0807 00:37:42.852974 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:42.852985 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:42.853022 (+ 37us) server_negotiation.cc:407] Connection header received
0807 00:37:42.853170 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:42.853179 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:42.853273 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:42.854449 (+ 1176us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:42.854614 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:42.855814 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:42.856747 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:42.857185 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:42.857318 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:42.859979 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:42.859984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:42.859984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:42.859999 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:42.862007 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:42.862417 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:42.862420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:42.862421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:42.862545 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:42.862812 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:42.862813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:42.862813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:42.863111 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:42.863307 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:42.863415 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 00:37:42.863581 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":71,"threads_started":1}
I20260807 00:37:42.910995 22605 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:37:42.911612 22605 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:37:42.916090 22605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Generated new TSK 0
I20260807 00:37:42.916378 22605 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:37:42.958711 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44809
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:43.044409 22620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:43.044620 22620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:43.044643 22620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:43.045785 22620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:43.045825 22620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:43.045851 22620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:37:43.047355 22620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:43.047562 22620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:43.047782 22620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:43.053606 22628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:43.053606 22626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.053859 22620 server_base.cc:1034] running on GCE node
W20260807 00:37:43.053601 22625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.054167 22620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:43.054435 22620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:43.055619 22620 hybrid_clock.cc:648] HybridClock initialized: now 1786063063055598 us; error 67 us; skew 500 ppm
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:43.058457 22620 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:37:43.059074 22620 webserver.cc:460] Webserver started at http://127.7.252.1:45093/ using document root <none> and password file <none>
I20260807 00:37:43.059345 22620 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:43.059414 22620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:43.059576 22620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:43.060775 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "3a6255000899469d9db040b5f80dc3b8"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "e71a15e2814929977f7d7d21e5c68edd"
server_key_iv: "9060dbbe93462d54ba494593de04ea78"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.061160 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "3a6255000899469d9db040b5f80dc3b8"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "e71a15e2814929977f7d7d21e5c68edd"
server_key_iv: "9060dbbe93462d54ba494593de04ea78"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.062753 22620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:37:43.063791 22635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.063988 22620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:43.064116 22620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "3a6255000899469d9db040b5f80dc3b8"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "e71a15e2814929977f7d7d21e5c68edd"
server_key_iv: "9060dbbe93462d54ba494593de04ea78"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.064294 22620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:43.092900 22620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:43.095511 22620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:43.095651 22620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:43.095856 22620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:43.096148 22620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:43.096180 22620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.096203 22620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:43.096215 22620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.102134 22620 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:45885
I20260807 00:37:43.102233 22750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:45885 every 8 connection(s)
I20260807 00:37:43.102561 22620 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:37:43.104780 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22620
I20260807 00:37:43.105042 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:37:43.105252 8176 external_mini_cluster.cc:1428] Setting key cd303fc8ab6303bd5557570bcfeca4f7
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:43.113870 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.103439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:53741 (local address 127.7.252.62:44809)
0807 00:37:43.103525 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.103527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.103767 (+ 240us) server_negotiation.cc:407] Connection header received
0807 00:37:43.104347 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.104348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.104367 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.104429 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:43.105712 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.106325 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.107550 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.107773 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.107857 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.110336 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:43.110338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:43.110338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:43.110347 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:43.112271 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.112741 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.112743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.112743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.112811 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.113090 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.113090 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.113091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.113244 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:43.113328 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.113632 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.113748 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 00:37:43.114027 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.103325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:53741)
0807 00:37:43.103614 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.103658 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.104175 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.104500 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.104504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.105379 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:43.105621 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.105627 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.106430 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.106431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.107455 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.107458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.107865 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.107866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.107998 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.108609 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:43.108618 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:43.110218 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:43.112379 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:43.112387 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:43.112390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:43.112662 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:43.112899 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:43.112900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:43.112901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:43.113017 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:43.113331 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:43.113339 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:43.113480 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.113584 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.113732 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":117,"threads_started":1}
I20260807 00:37:43.114813 22751 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44809
I20260807 00:37:43.114933 22751 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:43.115159 22751 heartbeater.cc:511] Master 127.7.252.62:44809 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:37:43.115842 22553 ts_manager.cc:194] Registered new tserver with Master: 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885)
I20260807 00:37:43.116662 22553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:53741
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:37:43.139426 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44809
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:43.224457 22757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:43.224690 22757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:43.224717 22757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:43.225983 22757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:43.226035 22757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:43.226064 22757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:37:43.227706 22757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:43.227944 22757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:43.228152 22757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:43.233963 22762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:43.233942 22767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.234081 22757 server_base.cc:1034] running on GCE node
W20260807 00:37:43.233942 22763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.234555 22757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:43.234936 22757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:43.236107 22757 hybrid_clock.cc:648] HybridClock initialized: now 1786063063236089 us; error 48 us; skew 500 ppm
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:43.239241 22757 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:37:43.239852 22757 webserver.cc:460] Webserver started at http://127.7.252.2:34979/ using document root <none> and password file <none>
I20260807 00:37:43.240131 22757 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:43.240204 22757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:43.240358 22757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:43.241492 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "b3c71d40b90b4139bff00eb65a2906f2"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "07359a3280fa1f92540ab58dca18e64d"
server_key_iv: "ecc3bff89827f8cf822c93125ffb0529"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.241883 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "b3c71d40b90b4139bff00eb65a2906f2"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "07359a3280fa1f92540ab58dca18e64d"
server_key_iv: "ecc3bff89827f8cf822c93125ffb0529"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.243436 22757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:37:43.244423 22774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.244809 22757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:43.244921 22757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "b3c71d40b90b4139bff00eb65a2906f2"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "07359a3280fa1f92540ab58dca18e64d"
server_key_iv: "ecc3bff89827f8cf822c93125ffb0529"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.244997 22757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:43.269047 22757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:43.271415 22757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:43.271595 22757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:43.271870 22757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:43.272217 22757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:43.272274 22757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.272320 22757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:43.272356 22757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.278739 22757 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:43043
I20260807 00:37:43.278810 22889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:43043 every 8 connection(s)
I20260807 00:37:43.279193 22757 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:37:43.286123 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22757
I20260807 00:37:43.286276 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:37:43.286525 8176 external_mini_cluster.cc:1428] Setting key 2d1fb018aad035b87e209fa7e032cc67
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:43.291301 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.280052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:49789)
0807 00:37:43.280244 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.280283 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.280905 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.281216 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.281221 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.281916 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:43.282135 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.282140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.283017 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.283018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.283934 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.283936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.284394 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.284396 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.284543 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.285173 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:43.285182 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:43.287209 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:43.289473 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:43.289485 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:43.289488 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:43.289892 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:43.290110 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:43.290111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:43.290112 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:43.290285 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:43.290565 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:43.290572 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:43.290797 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.290931 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.291113 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260807 00:37:43.291386 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.280068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:49789 (local address 127.7.252.62:44809)
0807 00:37:43.280150 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.280152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.280423 (+ 271us) server_negotiation.cc:407] Connection header received
0807 00:37:43.281045 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.281046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.281063 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.281114 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:43.282273 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.282903 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.284042 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.284268 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.284371 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.287345 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:43.287346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:43.287346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:43.287354 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:43.289333 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.289976 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.289977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.289977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.290037 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.290371 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.290372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.290372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.290495 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:43.290556 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.290982 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.291119 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:37:43.291917 22890 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44809
I20260807 00:37:43.292048 22890 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:43.292285 22890 heartbeater.cc:511] Master 127.7.252.62:44809 requested a full tablet report, sending...
I20260807 00:37:43.292773 22553 ts_manager.cc:194] Registered new tserver with Master: b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
I20260807 00:37:43.293226 22553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:49789
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:37:43.318486 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44809
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:43.403975 22896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:43.404242 22896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:43.404284 22896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:43.405507 22896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:43.405583 22896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:43.405628 22896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:37:43.407192 22896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:43.407481 22896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:43.407752 22896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:43.413311 22901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:43.413354 22903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:43.413319 22905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.413688 22896 server_base.cc:1034] running on GCE node
I20260807 00:37:43.413939 22896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:43.414209 22896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:43.415403 22896 hybrid_clock.cc:648] HybridClock initialized: now 1786063063415383 us; error 31 us; skew 500 ppm
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:43.418282 22896 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:37:43.418912 22896 webserver.cc:460] Webserver started at http://127.7.252.3:36169/ using document root <none> and password file <none>
I20260807 00:37:43.419157 22896 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:43.419229 22896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:43.419400 22896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:37:43.420539 22896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "37e58ef3b05249a08210aa4270691ef1"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "cef744f060715b8b7baca264d2009a03"
server_key_iv: "c0c35295485cd7032080d5fc806fefd6"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.420938 22896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "37e58ef3b05249a08210aa4270691ef1"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "cef744f060715b8b7baca264d2009a03"
server_key_iv: "c0c35295485cd7032080d5fc806fefd6"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.422415 22896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:37:43.423457 22912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.423671 22896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:37:43.423835 22896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "37e58ef3b05249a08210aa4270691ef1"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "cef744f060715b8b7baca264d2009a03"
server_key_iv: "c0c35295485cd7032080d5fc806fefd6"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.423921 22896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:43.439920 22896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:43.442441 22896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:43.442615 22896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:43.442898 22896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:43.443264 22896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:43.443318 22896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.443360 22896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:43.443392 22896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.450595 22896 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40791
I20260807 00:37:43.450729 23028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40791 every 8 connection(s)
I20260807 00:37:43.451213 22896 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:37:43.454834 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 22896
I20260807 00:37:43.454948 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:37:43.455155 8176 external_mini_cluster.cc:1428] Setting key e4dd6eda4a5b71a15186884ef82ab029
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:43.464010 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.452632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:49967 (local address 127.7.252.62:44809)
0807 00:37:43.452702 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.452704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.453149 (+ 445us) server_negotiation.cc:407] Connection header received
0807 00:37:43.453733 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.453735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.453752 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.453933 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:43.455259 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.455801 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.456984 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.457177 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.457238 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.460262 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:43.460264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:43.460264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:43.460272 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:43.461990 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.462740 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.462742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.462743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.462832 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.463180 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.463181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.463181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.463338 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:43.463415 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.463823 (+ 408us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.463927 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:37:43.464582 23031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.452537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:49967)
0807 00:37:43.452936 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.452992 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.453564 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.453967 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.453972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.454770 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:43.455140 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.455147 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.455896 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.455897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.456896 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.456899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.457259 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.457260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.457451 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.457984 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:43.457993 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:43.460005 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:43.462122 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:43.462133 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:43.462136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:43.462632 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:43.462925 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:43.462926 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:43.462926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:43.463105 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:43.463411 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:43.463418 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:43.463609 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.464163 (+ 554us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.464380 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":280,"threads_started":1}
I20260807 00:37:43.465271 23029 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44809
I20260807 00:37:43.465432 23029 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:43.465636 23029 heartbeater.cc:511] Master 127.7.252.62:44809 requested a full tablet report, sending...
I20260807 00:37:43.466115 22553 ts_manager.cc:194] Registered new tserver with Master: 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791)
I20260807 00:37:43.466586 22553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:49967
I20260807 00:37:43.467417 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:37:43.476835 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.468911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33142 (local address 127.7.252.62:44809)
0807 00:37:43.468993 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.468996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.469072 (+ 76us) server_negotiation.cc:407] Connection header received
0807 00:37:43.469119 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.469120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.469130 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.469279 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:43.469904 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.470502 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.471618 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.471980 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.472057 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.473607 (+ 1550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:43.473609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:43.473609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:43.473617 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:43.475399 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.475825 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.475826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.475827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.475891 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:43.476097 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:43.476097 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:43.476098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:43.476305 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:43.476400 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.476585 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.476681 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 00:37:43.479249 22552 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:37:43.481390 22552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:37:43.489670 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.485271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43840 (local address 127.7.252.2:43043)
0807 00:37:43.485957 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.485961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.485971 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:37:43.486010 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.486012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.486027 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.486106 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.486241 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.487329 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.488433 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.489171 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.489254 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.489322 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.489527 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.489573 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":87,"threads_started":1}
I20260807 00:37:43.489682 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.485031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43043 (local address 127.0.0.1:43840)
0807 00:37:43.485436 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.485445 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.485487 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.486119 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.486119 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.486122 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.486166 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.486167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.487443 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.487444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.488305 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.488308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.489277 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.489278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.489392 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.489413 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.489500 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.489565 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":21,"thread_start_us":79,"threads_started":1}
I20260807 00:37:43.490223 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.485032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48156 (local address 127.7.252.3:40791)
0807 00:37:43.485626 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.485630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.485656 (+ 26us) server_negotiation.cc:407] Connection header received
0807 00:37:43.485695 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.485697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.485713 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.485806 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.485957 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.487111 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.488399 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.489171 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.489254 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.489322 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.490080 (+ 758us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.490131 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":86,"threads_started":1}
I20260807 00:37:43.489682 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.484761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40791 (local address 127.0.0.1:48156)
0807 00:37:43.485076 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.485122 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.485216 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.485806 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.485807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.485810 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.485865 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.485867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.487215 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.487216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.488292 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.488295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.489279 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.489280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.489481 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.489485 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.489538 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.489571 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":5,"thread_start_us":114,"threads_started":1}
I20260807 00:37:43.490712 22823 tablet_service.cc:1467] Processing CreateTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 (DEFAULT_TABLE table=test-table [id=c23d9dd9c0124dbdbd98f6cb7666c22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:43.490922 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.484947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60138 (local address 127.7.252.1:45885)
0807 00:37:43.485597 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.485601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.485610 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:37:43.485642 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.485644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.485657 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.485741 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.485943 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.486829 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.489368 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.490530 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.490607 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.490690 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.490797 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.490837 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":113,"threads_started":1}
I20260807 00:37:43.490895 23043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.484761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.0.0.1:60138)
0807 00:37:43.485317 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.485423 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.485483 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.485768 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.485771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.485773 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.485861 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.485863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.486937 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.486939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.488310 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.488312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.490609 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.490610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.490720 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.490724 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.490772 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.490819 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"mutex_wait_us":36,"thread_start_us":115,"threads_started":1}
I20260807 00:37:43.491014 22961 tablet_service.cc:1467] Processing CreateTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 (DEFAULT_TABLE table=test-table [id=c23d9dd9c0124dbdbd98f6cb7666c22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:43.491145 22823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36d8b38fa3014164a89a3d200fea58c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:43.491358 22961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36d8b38fa3014164a89a3d200fea58c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:43.491755 22684 tablet_service.cc:1467] Processing CreateTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 (DEFAULT_TABLE table=test-table [id=c23d9dd9c0124dbdbd98f6cb7666c22c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:43.492055 22684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36d8b38fa3014164a89a3d200fea58c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:43.494836 23047 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Bootstrap starting.
I20260807 00:37:43.495388 23048 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap starting.
I20260807 00:37:43.495609 23047 tablet_bootstrap.cc:654] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:43.496196 23048 tablet_bootstrap.cc:654] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:43.496268 23047 log.cc:824] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:43.496644 23046 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Bootstrap starting.
I20260807 00:37:43.496868 23048 log.cc:824] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:43.497311 23046 tablet_bootstrap.cc:654] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:43.497685 23048 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: No bootstrap required, opened a new log
I20260807 00:37:43.497776 23048 ts_tablet_manager.cc:1397] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:37:43.497807 23046 log.cc:824] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:43.498392 23047 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: No bootstrap required, opened a new log
I20260807 00:37:43.498477 23047 ts_tablet_manager.cc:1397] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 00:37:43.498641 23046 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: No bootstrap required, opened a new log
I20260807 00:37:43.498767 23046 ts_tablet_manager.cc:1397] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:37:43.499996 23047 raft_consensus.cc:348] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.500175 23047 raft_consensus.cc:374] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:43.500247 23047 raft_consensus.cc:729] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e58ef3b05249a08210aa4270691ef1, State: Initialized, Role: FOLLOWER
I20260807 00:37:43.500146 23048 raft_consensus.cc:348] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.500347 23048 raft_consensus.cc:374] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:43.500391 23048 raft_consensus.cc:729] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6255000899469d9db040b5f80dc3b8, State: Initialized, Role: FOLLOWER
I20260807 00:37:43.500401 23047 consensus_queue.cc:260] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.500542 23048 consensus_queue.cc:260] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.500721 23047 ts_tablet_manager.cc:1428] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 00:37:43.500885 23029 heartbeater.cc:503] Master 127.7.252.62:44809 was elected leader, sending a full tablet report...
I20260807 00:37:43.501049 22751 heartbeater.cc:503] Master 127.7.252.62:44809 was elected leader, sending a full tablet report...
I20260807 00:37:43.501076 23046 raft_consensus.cc:348] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.501271 23046 raft_consensus.cc:374] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:43.501266 23048 ts_tablet_manager.cc:1428] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:37:43.501317 23046 raft_consensus.cc:729] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c71d40b90b4139bff00eb65a2906f2, State: Initialized, Role: FOLLOWER
I20260807 00:37:43.501437 23046 consensus_queue.cc:260] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.501731 23046 ts_tablet_manager.cc:1428] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 00:37:43.501917 22890 heartbeater.cc:503] Master 127.7.252.62:44809 was elected leader, sending a full tablet report...
W20260807 00:37:43.529832 22891 tablet.cc:2369] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:37:43.603302 22753 tablet.cc:2369] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:37:43.702071 23030 tablet.cc:2369] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:37:43.814646 23052 raft_consensus.cc:482] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:43.814891 23052 raft_consensus.cc:504] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.815310 23052 leader_election.cc:288] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
I20260807 00:37:43.818495 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.815734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:35443 (local address 127.7.252.1:45885)
0807 00:37:43.815784 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.815786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.815875 (+ 89us) server_negotiation.cc:407] Connection header received
0807 00:37:43.815947 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.815948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.815962 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.816019 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.816239 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.816736 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.817739 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.818103 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.818188 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.818198 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.818380 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.818427 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 00:37:43.818492 23055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.815555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.7.252.3:35443)
0807 00:37:43.815805 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.815815 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.815873 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.816072 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.816073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.816075 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.816148 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.816149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.816830 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.816831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.817619 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.817621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.818203 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.818204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.818272 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.818275 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.818346 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.818389 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":15,"thread_start_us":109,"threads_started":1}
I20260807 00:37:43.818594 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.815672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:56537 (local address 127.7.252.2:43043)
0807 00:37:43.815729 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.815731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.815746 (+ 15us) server_negotiation.cc:407] Connection header received
0807 00:37:43.815781 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.815781 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.815796 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.815870 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.816075 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.816640 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.817701 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.818098 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.818179 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.818193 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.818421 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.818473 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:37:43.818485 23054 raft_consensus.cc:482] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:43.818836 23031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.815545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43043 (local address 127.7.252.3:56537)
0807 00:37:43.815616 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.815632 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.815706 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.815887 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.815888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.815890 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.815974 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.815976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.816722 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.816723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.817595 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.817597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.818183 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.818184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.818269 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.818272 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.818507 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.818771 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 00:37:43.818827 23054 raft_consensus.cc:504] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.819027 22704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36d8b38fa3014164a89a3d200fea58c9" candidate_uuid: "37e58ef3b05249a08210aa4270691ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6255000899469d9db040b5f80dc3b8" is_pre_election: true
I20260807 00:37:43.819120 22844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36d8b38fa3014164a89a3d200fea58c9" candidate_uuid: "37e58ef3b05249a08210aa4270691ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3c71d40b90b4139bff00eb65a2906f2" is_pre_election: true
I20260807 00:37:43.819202 22704 raft_consensus.cc:2454] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e58ef3b05249a08210aa4270691ef1 in term 0.
I20260807 00:37:43.819223 22844 raft_consensus.cc:2454] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e58ef3b05249a08210aa4270691ef1 in term 0.
I20260807 00:37:43.819463 22916 leader_election.cc:302] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e58ef3b05249a08210aa4270691ef1, 3a6255000899469d9db040b5f80dc3b8; no voters:
I20260807 00:37:43.819654 23052 raft_consensus.cc:2781] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:37:43.819705 23052 raft_consensus.cc:482] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:37:43.819736 23052 raft_consensus.cc:3037] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:43.820050 23054 leader_election.cc:288] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885)
I20260807 00:37:43.820650 23052 raft_consensus.cc:504] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.820797 23052 leader_election.cc:288] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [CANDIDATE]: Term 1 election: Requested vote from peers 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
I20260807 00:37:43.821022 22704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36d8b38fa3014164a89a3d200fea58c9" candidate_uuid: "37e58ef3b05249a08210aa4270691ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6255000899469d9db040b5f80dc3b8"
I20260807 00:37:43.821120 22704 raft_consensus.cc:3037] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:43.821841 22704 raft_consensus.cc:2454] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e58ef3b05249a08210aa4270691ef1 in term 1.
I20260807 00:37:43.822007 22916 leader_election.cc:302] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e58ef3b05249a08210aa4270691ef1, 3a6255000899469d9db040b5f80dc3b8; no voters:
I20260807 00:37:43.822108 22844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36d8b38fa3014164a89a3d200fea58c9" candidate_uuid: "37e58ef3b05249a08210aa4270691ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3c71d40b90b4139bff00eb65a2906f2"
I20260807 00:37:43.822204 22844 raft_consensus.cc:3037] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:43.822225 23052 raft_consensus.cc:2781] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:43.822395 23052 raft_consensus.cc:686] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 1 LEADER]: Becoming Leader. State: Replica: 37e58ef3b05249a08210aa4270691ef1, State: Running, Role: LEADER
I20260807 00:37:43.822499 23052 consensus_queue.cc:237] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:43.823118 22844 raft_consensus.cc:2454] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e58ef3b05249a08210aa4270691ef1 in term 1.
I20260807 00:37:43.823153 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.819453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:50023 (local address 127.7.252.3:40791)
0807 00:37:43.819517 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.819520 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.819598 (+ 78us) server_negotiation.cc:407] Connection header received
0807 00:37:43.819695 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.819696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.819707 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.819751 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.819971 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.820687 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.822181 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.822711 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.822785 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.822797 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.823034 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.823081 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:37:43.823251 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.819893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:35185 (local address 127.7.252.1:45885)
0807 00:37:43.819930 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.819932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.819939 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:37:43.819960 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.819961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.819970 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.820022 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:43.820268 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.820928 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.822220 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.822785 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.822862 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.822874 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.823129 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.823185 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:37:43.823351 23056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.819379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40791 (local address 127.7.252.2:50023)
0807 00:37:43.819540 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.819550 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.819623 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.819822 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.819823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.819825 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.819888 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.819890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.820796 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.820797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.822092 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.822095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.822860 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.822861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.822941 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.822945 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.823219 (+ 274us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.823278 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":6,"thread_start_us":101,"threads_started":1}
I20260807 00:37:43.823455 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.819738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.7.252.2:35185)
0807 00:37:43.819854 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.819865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:43.819917 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:43.820024 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:43.820025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:43.820026 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:43.820098 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.820099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.821009 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.821010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.822097 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:43.822099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.822912 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.822913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:43.823036 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.823040 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:43.823329 (+ 289us) client_negotiation.cc:240] Negotiation successful
0807 00:37:43.823376 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":70,"threads_started":1}
I20260807 00:37:43.823405 22553 catalog_manager.cc:5495] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "37e58ef3b05249a08210aa4270691ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } health_report { overall_health: UNKNOWN } } }
I20260807 00:37:43.823724 22704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36d8b38fa3014164a89a3d200fea58c9" candidate_uuid: "b3c71d40b90b4139bff00eb65a2906f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6255000899469d9db040b5f80dc3b8" is_pre_election: true
I20260807 00:37:43.823840 22704 raft_consensus.cc:2379] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3c71d40b90b4139bff00eb65a2906f2 in current term 1: Already voted for candidate 37e58ef3b05249a08210aa4270691ef1 in this term.
I20260807 00:37:43.824177 22982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36d8b38fa3014164a89a3d200fea58c9" candidate_uuid: "b3c71d40b90b4139bff00eb65a2906f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e58ef3b05249a08210aa4270691ef1" is_pre_election: true
I20260807 00:37:43.824494 22776 leader_election.cc:302] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3c71d40b90b4139bff00eb65a2906f2; no voters: 37e58ef3b05249a08210aa4270691ef1, 3a6255000899469d9db040b5f80dc3b8
I20260807 00:37:43.824622 23054 raft_consensus.cc:2726] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 00:37:43.843730 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:43.841207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.7.252.3:40791)
0807 00:37:43.841257 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:43.841259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:43.841270 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:37:43.841324 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:43.841324 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:43.841342 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:43.841416 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:37:43.841537 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.842016 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.842861 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:43.843050 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:43.843132 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:43.843365 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:37:43.843465 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:37:43.843561 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:43.843603 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 00:37:43.843628 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:37:43.845491 22844 raft_consensus.cc:1261] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Refusing update from remote peer 37e58ef3b05249a08210aa4270691ef1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:43.845511 22704 raft_consensus.cc:1261] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Refusing update from remote peer 37e58ef3b05249a08210aa4270691ef1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:43.845929 23058 consensus_queue.cc:1035] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:43.846064 23052 consensus_queue.cc:1035] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:43.851154 22553 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:37:43.851246 22553 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:37:43.852133 22553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Sending DeleteTablet for 3 replicas of tablet 36d8b38fa3014164a89a3d200fea58c9
I20260807 00:37:43.852514 22961 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:43 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:48156
I20260807 00:37:43.852542 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22620
I20260807 00:37:43.852648 22684 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:43 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:60138
I20260807 00:37:43.853123 22823 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:43 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:43840
I20260807 00:37:43.853363 23073 tablet_replica.cc:330] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: stopping tablet replica
I20260807 00:37:43.853528 23073 raft_consensus.cc:2229] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:37:43.853698 23073 raft_consensus.cc:2258] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:43.854310 23073 ts_tablet_manager.cc:1905] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:43.855967 23072 tablet_replica.cc:330] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: stopping tablet replica
I20260807 00:37:43.856158 23072 raft_consensus.cc:2229] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:37:43.856323 23073 ts_tablet_manager.cc:1918] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:43.856331 23072 raft_consensus.cc:2258] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:43.856428 23073 log.cc:1196] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/36d8b38fa3014164a89a3d200fea58c9
I20260807 00:37:43.856765 23073 ts_tablet_manager.cc:1939] T 36d8b38fa3014164a89a3d200fea58c9 P b3c71d40b90b4139bff00eb65a2906f2: Deleting consensus metadata
I20260807 00:37:43.857000 23072 ts_tablet_manager.cc:1905] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:43.857223 22538 catalog_manager.cc:4841] TS b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): tablet 36d8b38fa3014164a89a3d200fea58c9 (table test-table [id=c23d9dd9c0124dbdbd98f6cb7666c22c]) successfully deleted
I20260807 00:37:43.859297 23072 ts_tablet_manager.cc:1918] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:43.859431 23072 log.cc:1196] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/36d8b38fa3014164a89a3d200fea58c9
I20260807 00:37:43.859793 23072 ts_tablet_manager.cc:1939] T 36d8b38fa3014164a89a3d200fea58c9 P 37e58ef3b05249a08210aa4270691ef1: Deleting consensus metadata
I20260807 00:37:43.860342 22538 catalog_manager.cc:4841] TS 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): tablet 36d8b38fa3014164a89a3d200fea58c9 (table test-table [id=c23d9dd9c0124dbdbd98f6cb7666c22c]) successfully deleted
W20260807 00:37:43.860877 22540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:45885 (error 108)
W20260807 00:37:43.861517 23041 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:37:43.861372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.0.0.1:60142)
0807 00:37:43.861428 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:43.861469 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45885: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 00:37:43.861686 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22757
W20260807 00:37:43.861662 22540 catalog_manager.cc:4584] TS 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 36d8b38fa3014164a89a3d200fea58c9: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45885: connect: Connection reset by peer (error 104)
I20260807 00:37:43.867892 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22896
I20260807 00:37:43.872915 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 22521
I20260807 00:37:43.879822 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44809
--webserver_interface=127.7.252.62
--webserver_port=41205
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:43.965134 23075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:43.965374 23075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:43.965399 23075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:43.966625 23075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:43.966706 23075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:43.966722 23075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:43.966735 23075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:43.966747 23075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:43.968549 23075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=41205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:43.968842 23075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:43.969095 23075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:43.979811 23082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:43.979811 23084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.979951 23075 server_base.cc:1034] running on GCE node
W20260807 00:37:43.979811 23081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:43.980589 23075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:43.980981 23075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:43.982156 23075 hybrid_clock.cc:648] HybridClock initialized: now 1786063063982134 us; error 38 us; skew 500 ppm
Aug 07 00:37:43 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:43.985242 23075 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:43.985853 23075 webserver.cc:460] Webserver started at http://127.7.252.62:41205/ using document root <none> and password file <none>
I20260807 00:37:43.986122 23075 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:43.986222 23075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:43.987849 23075 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:43.988600 23091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:43.988787 23075 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:43.988899 23075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "9eb3fc501279432281a4ceab79622c09"
format_stamp: "Formatted at 2026-08-07 00:37:42 on dist-test-slave-csg5"
server_key: "de14b1dbfa13cd43008c440a05c2bb72"
server_key_iv: "72ed4656ad435768c066c43b8651df7b"
server_key_version: "encryptionkey@0"
I20260807 00:37:43.989319 23075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:44.001711 23075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:44.003866 23075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:44.004038 23075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:44.008385 23075 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44809
I20260807 00:37:44.008421 23145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44809 every 8 connection(s)
I20260807 00:37:44.008828 23075 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:44.010599 23146 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:37:44.011371 23146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap starting.
I20260807 00:37:44.015865 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23075
I20260807 00:37:44.016184 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:45885
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:44809
--webserver_port=45093
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:44.020779 23146 log.cc:824] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:44.022905 23146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:37:44.023208 23146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap complete.
I20260807 00:37:44.025733 23146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.026005 23146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb3fc501279432281a4ceab79622c09, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.026192 23146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.026275 23146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:37:44.026353 23146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:37:44.026407 23146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 1 FOLLOWER]: Advancing to term 2
I20260807 00:37:44.027540 23146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.027661 23146 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eb3fc501279432281a4ceab79622c09; no voters:
I20260807 00:37:44.027865 23146 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 00:37:44.027904 23150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 00:37:44.028019 23150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 LEADER]: Becoming Leader. State: Replica: 9eb3fc501279432281a4ceab79622c09, State: Running, Role: LEADER
I20260807 00:37:44.028118 23150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.028164 23146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:44.028376 23151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9eb3fc501279432281a4ceab79622c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } } }
I20260807 00:37:44.028591 23151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:44.028534 23152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb3fc501279432281a4ceab79622c09. Latest consensus state: current_term: 2 leader_uuid: "9eb3fc501279432281a4ceab79622c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } } }
I20260807 00:37:44.028849 23152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:44.029001 23157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:44.029896 23157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:37:44.030009 23157 catalog_manager.cc:1259] Loaded cluster ID: 8677e5cb0f52474da5e1401824b5baf9
I20260807 00:37:44.030048 23157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:37:44.030373 23157 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 00:37:44.033295 23157 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 00:37:44.039835 23157 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:37:44.040095 23157 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Loaded TSK: 0
I20260807 00:37:44.040372 23157 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 00:37:44.117676 23148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:44.117945 23148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:44.117990 23148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:44.119295 23148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:44.119361 23148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:44.119410 23148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:37:44.120918 23148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:45885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=45093
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:44.121189 23148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:44.121433 23148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:44.128346 23178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.128372 23176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.128665 23148 server_base.cc:1034] running on GCE node
W20260807 00:37:44.128669 23175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.128944 23148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:44.129271 23148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:44.130462 23148 hybrid_clock.cc:648] HybridClock initialized: now 1786063064130447 us; error 33 us; skew 500 ppm
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:44.133745 23148 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:37:44.134282 23148 webserver.cc:460] Webserver started at http://127.7.252.1:45093/ using document root <none> and password file <none>
I20260807 00:37:44.134519 23148 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:44.134601 23148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:44.136113 23148 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.136916 23186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.137179 23148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.137285 23148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "3a6255000899469d9db040b5f80dc3b8"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "e71a15e2814929977f7d7d21e5c68edd"
server_key_iv: "9060dbbe93462d54ba494593de04ea78"
server_key_version: "encryptionkey@0"
I20260807 00:37:44.137765 23148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:44.147970 23148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:44.151031 23148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:44.151203 23148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:44.151484 23148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:44.152031 23193 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 00:37:44.153680 23148 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 00:37:44.153753 23148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 00:37:44.153795 23148 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 00:37:44.154763 23148 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 00:37:44.154817 23148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260807 00:37:44.154938 23193 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap starting.
I20260807 00:37:44.162413 23148 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:45885
I20260807 00:37:44.162470 23303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:45885 every 8 connection(s)
I20260807 00:37:44.162969 23148 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:37:44.166311 23193 log.cc:824] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:44.168992 23193 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:37:44.169342 23193 tablet_bootstrap.cc:492] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap complete.
I20260807 00:37:44.170637 23193 ts_tablet_manager.cc:1397] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.012s
I20260807 00:37:44.171883 23193 raft_consensus.cc:348] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:44.172224 23193 raft_consensus.cc:729] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6255000899469d9db040b5f80dc3b8, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.172395 23193 consensus_queue.cc:260] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } }
I20260807 00:37:44.172629 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23148
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:44.172693 23193 ts_tablet_manager.cc:1428] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 00:37:44.172940 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:43043
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:44809
--webserver_port=34979
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:44.179716 23306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.163753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:36637)
0807 00:37:44.164181 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.164238 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.165087 (+ 849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.165663 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.165668 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.166064 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:44.166354 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.166362 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.168069 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.168070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.169463 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.169468 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.170378 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.170379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.170535 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.171234 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:44.171245 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:44.175549 (+ 4304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:44.177929 (+ 2380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.177939 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.177941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.178196 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.178487 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.178488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.178489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.178607 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.179046 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:44.179053 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:44.179194 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.179304 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.179505 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":103,"threads_started":1}
I20260807 00:37:44.179730 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.163881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:36637 (local address 127.7.252.62:44809)
0807 00:37:44.164092 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.164103 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.164393 (+ 290us) server_negotiation.cc:407] Connection header received
0807 00:37:44.165360 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.165368 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.165429 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.165585 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:44.166510 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.167930 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.169559 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.170263 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.170394 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.175753 (+ 5359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:44.175759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:44.175759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:44.175774 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:44.177804 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.178288 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.178292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.178292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.178398 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.178702 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.178703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.178703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.178959 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:44.179053 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.179362 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.179505 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":112,"threads_started":1}
I20260807 00:37:44.180861 23304 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44809
I20260807 00:37:44.180979 23304 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:44.181177 23304 heartbeater.cc:511] Master 127.7.252.62:44809 requested a full tablet report, sending...
I20260807 00:37:44.181939 23110 ts_manager.cc:194] Registered new tserver with Master: 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885)
I20260807 00:37:44.183135 23110 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:36637
I20260807 00:37:44.184113 23304 heartbeater.cc:503] Master 127.7.252.62:44809 was elected leader, sending a full tablet report...
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063063, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.1@KRBTEST.COM
I20260807 00:37:44.191871 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.182823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60158 (local address 127.7.252.1:45885)
0807 00:37:44.183334 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.183339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.183349 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:37:44.183386 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.183388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.183403 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.183550 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:44.184158 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.185052 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.185869 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.186217 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.186305 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.188801 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:44.188810 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:44.188810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:44.188818 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:44.190407 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.190924 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.190927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.190927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.190987 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.191198 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.191199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.191200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.191360 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:44.191455 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.191666 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.191768 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":78,"threads_started":1}
I20260807 00:37:44.191893 23311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.182531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.0.0.1:60158)
0807 00:37:44.182987 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.183024 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.183090 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.183615 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.183620 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.183970 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:44.184059 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.184062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.185153 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.185154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.185752 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.185755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.186314 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.186316 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.186420 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.186969 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:44.186973 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:44.188704 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:44.190514 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.190522 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.190524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.190820 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.191055 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.191056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.191057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.191120 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.191431 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:44.191439 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:44.191496 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.191632 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.191768 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":105,"threads_started":1}
I20260807 00:37:44.192584 23237 tablet_service.cc:1514] Processing DeleteTablet for tablet 36d8b38fa3014164a89a3d200fea58c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:43 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:60158
I20260807 00:37:44.193243 23313 tablet_replica.cc:330] stopping tablet replica
I20260807 00:37:44.193382 23313 raft_consensus.cc:2229] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:37:44.193463 23313 raft_consensus.cc:2258] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:44.193783 23313 ts_tablet_manager.cc:1905] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:44.196106 23313 ts_tablet_manager.cc:1918] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:44.196202 23313 log.cc:1196] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/36d8b38fa3014164a89a3d200fea58c9
I20260807 00:37:44.196525 23313 ts_tablet_manager.cc:1939] T 36d8b38fa3014164a89a3d200fea58c9 P 3a6255000899469d9db040b5f80dc3b8: Deleting consensus metadata
I20260807 00:37:44.197059 23095 catalog_manager.cc:4841] TS 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885): tablet 36d8b38fa3014164a89a3d200fea58c9 (table test-table [id=c23d9dd9c0124dbdbd98f6cb7666c22c]) successfully deleted
W20260807 00:37:44.268594 23310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:44.268836 23310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:44.268862 23310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:44.270107 23310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:44.270157 23310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:44.270186 23310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:37:44.271755 23310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:43043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=34979
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:44.271974 23310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:44.272174 23310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:44.278066 23321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.278126 23310 server_base.cc:1034] running on GCE node
W20260807 00:37:44.277956 23318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.277956 23319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.278487 23310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:44.278786 23310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:44.279961 23310 hybrid_clock.cc:648] HybridClock initialized: now 1786063064279951 us; error 35 us; skew 500 ppm
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:44.282894 23310 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:37:44.283401 23310 webserver.cc:460] Webserver started at http://127.7.252.2:34979/ using document root <none> and password file <none>
I20260807 00:37:44.283641 23310 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:44.283728 23310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:44.285354 23310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:44.286123 23328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.286460 23310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.286590 23310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "b3c71d40b90b4139bff00eb65a2906f2"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "07359a3280fa1f92540ab58dca18e64d"
server_key_iv: "ecc3bff89827f8cf822c93125ffb0529"
server_key_version: "encryptionkey@0"
I20260807 00:37:44.287022 23310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:44.299471 23310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:44.301780 23310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:44.301968 23310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:44.302224 23310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:44.302570 23310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:44.302608 23310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.302631 23310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:44.302644 23310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.309005 23310 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:43043
I20260807 00:37:44.309106 23444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:43043 every 8 connection(s)
I20260807 00:37:44.309459 23310 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:37:44.310230 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23310
I20260807 00:37:44.310586 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:40791
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:44809
--webserver_port=36169
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:44.321089 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.310255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:33467 (local address 127.7.252.62:44809)
0807 00:37:44.310423 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.310426 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.310960 (+ 534us) server_negotiation.cc:407] Connection header received
0807 00:37:44.311824 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.311825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.311836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.311885 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:44.313198 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.313780 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.315494 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.315706 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.315812 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.318131 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:44.318132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:44.318133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:44.318141 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:44.319693 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.320111 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.320113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.320114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.320169 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.320414 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.320415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.320415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.320534 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:44.320605 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.320895 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.320990 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260807 00:37:44.321288 23447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.310215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:33467)
0807 00:37:44.310800 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.310856 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.311705 (+ 849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.311964 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.311969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.312868 (+ 899us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:44.313086 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.313091 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.313894 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.313895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.315397 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.315401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.315832 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.315833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.315953 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.316571 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:44.316579 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:44.318032 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:44.319787 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.319794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.319797 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.320024 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.320233 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.320234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.320234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.320348 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.320608 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:44.320615 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:44.320756 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.320862 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.321028 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":90,"threads_started":1}
I20260807 00:37:44.321720 23445 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44809
I20260807 00:37:44.321820 23445 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:44.322032 23445 heartbeater.cc:511] Master 127.7.252.62:44809 requested a full tablet report, sending...
I20260807 00:37:44.322484 23110 ts_manager.cc:194] Registered new tserver with Master: b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
I20260807 00:37:44.322902 23110 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:33467
W20260807 00:37:44.408506 23448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:44.408792 23448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:44.408839 23448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:44.410187 23448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:44.410267 23448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:44.410317 23448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:37:44.412050 23448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:40791
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=36169
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:44.412361 23448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:44.412631 23448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:44.418516 23453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.418536 23454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.418519 23456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.419240 23448 server_base.cc:1034] running on GCE node
I20260807 00:37:44.419514 23448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:44.419814 23448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:44.421007 23448 hybrid_clock.cc:648] HybridClock initialized: now 1786063064420977 us; error 37 us; skew 500 ppm
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:44.424075 23448 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:37:44.424525 23448 webserver.cc:460] Webserver started at http://127.7.252.3:36169/ using document root <none> and password file <none>
I20260807 00:37:44.424721 23448 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:44.424777 23448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:44.426164 23448 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.426985 23463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.427202 23448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.427313 23448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "37e58ef3b05249a08210aa4270691ef1"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "cef744f060715b8b7baca264d2009a03"
server_key_iv: "c0c35295485cd7032080d5fc806fefd6"
server_key_version: "encryptionkey@0"
I20260807 00:37:44.427829 23448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:44.448161 23448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:44.450775 23448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:44.450940 23448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:44.451262 23448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:44.451658 23448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:44.451700 23448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.451726 23448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:44.451740 23448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.458503 23448 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40791
I20260807 00:37:44.458583 23579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40791 every 8 connection(s)
I20260807 00:37:44.459007 23448 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:37:44.468283 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23448
I20260807 00:37:44.471035 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.459885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:59027 (local address 127.7.252.62:44809)
0807 00:37:44.459975 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.459978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.460158 (+ 180us) server_negotiation.cc:407] Connection header received
0807 00:37:44.460785 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.460787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.460798 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.460861 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:44.461957 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.462500 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.463534 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.463729 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.463794 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.466528 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:44.466530 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:44.466530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:44.466542 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:44.469076 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.469743 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.469744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.469745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.469815 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.470148 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.470148 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.470149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.470395 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:44.470478 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.470843 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.470936 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 00:37:44.471365 23582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.459826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:59027)
0807 00:37:44.459999 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.460046 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.460660 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.460941 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.460944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.461659 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:44.461862 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.461868 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.462591 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.462591 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.463450 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.463452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.463835 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.463836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.463951 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.464476 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:44.464485 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:44.466400 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:44.469228 (+ 2828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.469239 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.469242 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.469632 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.469899 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:44.469900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:44.469901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:44.470073 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:44.470477 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:44.470485 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:44.470639 (+ 154us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.470814 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.470966 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260807 00:37:44.471976 23580 heartbeater.cc:347] Connected to a master server at 127.7.252.62:44809
I20260807 00:37:44.472090 23580 heartbeater.cc:464] Registering TS with master...
I20260807 00:37:44.472319 23580 heartbeater.cc:511] Master 127.7.252.62:44809 requested a full tablet report, sending...
I20260807 00:37:44.472864 23110 ts_manager.cc:194] Registered new tserver with Master: 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791)
I20260807 00:37:44.473394 23110 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:59027
I20260807 00:37:44.477317 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.468750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33152 (local address 127.7.252.62:44809)
0807 00:37:44.468907 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.468909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.469172 (+ 263us) server_negotiation.cc:407] Connection header received
0807 00:37:44.469268 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.469269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.469283 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.469385 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:44.470247 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.471058 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.472359 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.472660 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.472762 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.474466 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:44.474467 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:44.474468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:44.474474 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:44.475985 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.476478 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.476479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.476480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.476542 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:44.476795 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:44.476796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:44.476796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:44.476919 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:44.477064 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.477151 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.477238 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260807 00:37:44.478169 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:37:44.481566 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.478523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33168 (local address 127.7.252.62:44809)
0807 00:37:44.478586 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.478588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.478765 (+ 177us) server_negotiation.cc:407] Connection header received
0807 00:37:44.478828 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.478829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.478864 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.478932 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:37:44.479016 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.479534 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.480469 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.480694 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.480767 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.480955 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:37:44.481062 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:37:44.481133 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.481433 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.481471 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 00:37:44.482007 23110 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:37:44.484025 23110 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:37:44.486547 23237 tablet_service.cc:1467] Processing CreateTablet for tablet 81f2c13dcc1a4a42a1df05da65f61086 (DEFAULT_TABLE table=test-table [id=df352473ba224fb29d4917e316e5a2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:44.487116 23237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f2c13dcc1a4a42a1df05da65f61086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:44.488626 23193 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap starting.
I20260807 00:37:44.488981 23193 tablet_bootstrap.cc:654] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:44.489676 23193 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: No bootstrap required, opened a new log
I20260807 00:37:44.489737 23193 ts_tablet_manager.cc:1397] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 00:37:44.490116 23193 raft_consensus.cc:348] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.490203 23193 raft_consensus.cc:374] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:44.490259 23193 raft_consensus.cc:729] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6255000899469d9db040b5f80dc3b8, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.490324 23193 consensus_queue.cc:260] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.490432 23193 ts_tablet_manager.cc:1428] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 00:37:44.491477 23311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.486418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40791 (local address 127.0.0.1:48174)
0807 00:37:44.486476 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.486491 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.486541 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.487246 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.487247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.487249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:44.487330 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.487333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.488828 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.488829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.490217 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.490221 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.491162 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.491163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.491249 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.491276 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.491311 (+ 35us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.491368 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":54}
I20260807 00:37:44.491483 23586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.486517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43043 (local address 127.0.0.1:43854)
0807 00:37:44.486708 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.486717 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.486759 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.487335 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.487336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.487338 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:44.487372 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.487373 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.488831 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.488832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.490144 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.490148 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.491192 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.491192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.491251 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.491280 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.491311 (+ 31us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.491368 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":99,"thread_start_us":109,"threads_started":1}
I20260807 00:37:44.491653 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.486824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43854 (local address 127.7.252.2:43043)
0807 00:37:44.487034 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.487040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.487052 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:37:44.487096 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.487099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.487115 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.487529 (+ 414us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:44.487606 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.488717 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.490227 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.491056 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.491422 (+ 366us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.491499 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.491528 (+ 29us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.491579 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":105,"threads_started":1}
I20260807 00:37:44.491827 23587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.486810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48174 (local address 127.7.252.3:40791)
0807 00:37:44.487034 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.487040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.487052 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:37:44.487114 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.487116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.487130 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.487431 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:44.487504 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.488669 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.490301 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.491056 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.491599 (+ 543us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.491666 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.491693 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.491749 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
I20260807 00:37:44.492709 23379 tablet_service.cc:1467] Processing CreateTablet for tablet 81f2c13dcc1a4a42a1df05da65f61086 (DEFAULT_TABLE table=test-table [id=df352473ba224fb29d4917e316e5a2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:44.492702 23514 tablet_service.cc:1467] Processing CreateTablet for tablet 81f2c13dcc1a4a42a1df05da65f61086 (DEFAULT_TABLE table=test-table [id=df352473ba224fb29d4917e316e5a2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:37:44.493063 23514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f2c13dcc1a4a42a1df05da65f61086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:44.493068 23379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f2c13dcc1a4a42a1df05da65f61086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:37:44.496037 23590 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Bootstrap starting.
I20260807 00:37:44.496055 23591 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Bootstrap starting.
I20260807 00:37:44.496702 23590 tablet_bootstrap.cc:654] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:44.496739 23591 tablet_bootstrap.cc:654] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Neither blocks nor log segments found. Creating new log.
I20260807 00:37:44.497227 23591 log.cc:824] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:44.497227 23590 log.cc:824] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:44.498147 23591 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: No bootstrap required, opened a new log
I20260807 00:37:44.498236 23591 ts_tablet_manager.cc:1397] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 00:37:44.498385 23590 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: No bootstrap required, opened a new log
I20260807 00:37:44.498450 23590 ts_tablet_manager.cc:1397] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:37:44.500404 23591 raft_consensus.cc:348] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.500425 23590 raft_consensus.cc:348] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.500622 23590 raft_consensus.cc:374] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:44.500622 23591 raft_consensus.cc:374] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:37:44.500662 23590 raft_consensus.cc:729] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e58ef3b05249a08210aa4270691ef1, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.500662 23591 raft_consensus.cc:729] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c71d40b90b4139bff00eb65a2906f2, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.500814 23591 consensus_queue.cc:260] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.500808 23590 consensus_queue.cc:260] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.501160 23591 ts_tablet_manager.cc:1428] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:37:44.501196 23445 heartbeater.cc:503] Master 127.7.252.62:44809 was elected leader, sending a full tablet report...
I20260807 00:37:44.501436 23590 ts_tablet_manager.cc:1428] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:37:44.501463 23580 heartbeater.cc:503] Master 127.7.252.62:44809 was elected leader, sending a full tablet report...
I20260807 00:37:44.519202 23595 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:44.519402 23595 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.519764 23595 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885)
I20260807 00:37:44.523660 23587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.520109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:45187 (local address 127.7.252.3:40791)
0807 00:37:44.520168 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.520171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.520303 (+ 132us) server_negotiation.cc:407] Connection header received
0807 00:37:44.520371 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.520372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.520384 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.520435 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:44.520589 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.521360 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.522694 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.523260 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.523320 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.523332 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.523536 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.523578 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 00:37:44.523692 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.520079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:47867 (local address 127.7.252.1:45885)
0807 00:37:44.520147 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.520149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.520160 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:37:44.520192 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.520193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.520226 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.520325 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:37:44.520522 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.521437 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.522522 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.523232 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.523319 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.523410 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.523560 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.523613 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:37:44.523698 23447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.519979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.7.252.2:47867)
0807 00:37:44.520050 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.520063 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.520108 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.520340 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.520341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.520343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:44.520441 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.520443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.521547 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.521548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.522417 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.522420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.523386 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.523387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.523459 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.523463 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.523537 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.523590 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":50}
I20260807 00:37:44.523705 23596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.519979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40791 (local address 127.7.252.2:45187)
0807 00:37:44.520225 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.520235 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.520313 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.520451 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:44.520452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:44.520454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:37:44.520520 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.520521 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.521500 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.521501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.522561 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:44.522566 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.523369 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.523370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:44.523449 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.523453 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:37:44.523528 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 00:37:44.523573 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":47,"thread_start_us":128,"threads_started":1}
I20260807 00:37:44.524098 23257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f2c13dcc1a4a42a1df05da65f61086" candidate_uuid: "b3c71d40b90b4139bff00eb65a2906f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6255000899469d9db040b5f80dc3b8" is_pre_election: true
I20260807 00:37:44.524297 23257 raft_consensus.cc:2454] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3c71d40b90b4139bff00eb65a2906f2 in term 0.
I20260807 00:37:44.524287 23534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f2c13dcc1a4a42a1df05da65f61086" candidate_uuid: "b3c71d40b90b4139bff00eb65a2906f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e58ef3b05249a08210aa4270691ef1" is_pre_election: true
I20260807 00:37:44.524452 23534 raft_consensus.cc:2454] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3c71d40b90b4139bff00eb65a2906f2 in term 0.
I20260807 00:37:44.524570 23332 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8, b3c71d40b90b4139bff00eb65a2906f2; no voters:
I20260807 00:37:44.524760 23595 raft_consensus.cc:2781] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:37:44.524811 23595 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:37:44.524829 23595 raft_consensus.cc:3037] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:44.525594 23595 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.525831 23595 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [CANDIDATE]: Term 1 election: Requested vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885)
I20260807 00:37:44.525913 23257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f2c13dcc1a4a42a1df05da65f61086" candidate_uuid: "b3c71d40b90b4139bff00eb65a2906f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6255000899469d9db040b5f80dc3b8"
I20260807 00:37:44.525995 23257 raft_consensus.cc:3037] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:44.526904 23257 raft_consensus.cc:2454] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3c71d40b90b4139bff00eb65a2906f2 in term 1.
I20260807 00:37:44.527014 23534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f2c13dcc1a4a42a1df05da65f61086" candidate_uuid: "b3c71d40b90b4139bff00eb65a2906f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e58ef3b05249a08210aa4270691ef1"
I20260807 00:37:44.527136 23332 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8, b3c71d40b90b4139bff00eb65a2906f2; no voters:
I20260807 00:37:44.527119 23534 raft_consensus.cc:3037] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:37:44.527275 23595 raft_consensus.cc:2781] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:37:44.527503 23595 raft_consensus.cc:686] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 LEADER]: Becoming Leader. State: Replica: b3c71d40b90b4139bff00eb65a2906f2, State: Running, Role: LEADER
I20260807 00:37:44.527626 23595 consensus_queue.cc:237] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.528108 23534 raft_consensus.cc:2454] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3c71d40b90b4139bff00eb65a2906f2 in term 1.
I20260807 00:37:44.528684 23108 catalog_manager.cc:5495] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2). New cstate: current_term: 1 leader_uuid: "b3c71d40b90b4139bff00eb65a2906f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } health_report { overall_health: UNKNOWN } } }
I20260807 00:37:44.541906 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:44.539155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43862 (local address 127.7.252.2:43043)
0807 00:37:44.539232 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:44.539234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:44.539245 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:37:44.539297 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:44.539298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:44.539319 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:44.539386 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:37:44.539503 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.539998 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.541009 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:44.541197 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:44.541260 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:44.541454 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:37:44.541558 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:37:44.541624 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:44.541723 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 00:37:44.541747 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 00:37:44.544121 23257 raft_consensus.cc:1261] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Refusing update from remote peer b3c71d40b90b4139bff00eb65a2906f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:44.544147 23534 raft_consensus.cc:1261] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Refusing update from remote peer b3c71d40b90b4139bff00eb65a2906f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:37:44.544533 23595 consensus_queue.cc:1035] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:44.544708 23597 consensus_queue.cc:1035] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:37:44.547586 23601 mvcc.cc:205] Tried to move back new op lower bound from 7315714312369930240 to 7315714312306053120. Current Snapshot: MvccSnapshot[applied={T|T < 7315714312369930240}]
I20260807 00:37:44.549973 23110 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:37:44.550088 23110 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:37:44.550899 23110 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Sending DeleteTablet for 3 replicas of tablet 81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:44.551221 23237 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f2c13dcc1a4a42a1df05da65f61086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:44 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:60158
I20260807 00:37:44.551330 23514 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f2c13dcc1a4a42a1df05da65f61086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:44 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:48174
I20260807 00:37:44.551448 23313 tablet_replica.cc:330] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: stopping tablet replica
I20260807 00:37:44.551513 23313 raft_consensus.cc:2229] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:37:44.551566 23379 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f2c13dcc1a4a42a1df05da65f61086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:37:44 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:43854
I20260807 00:37:44.551604 23313 raft_consensus.cc:2258] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:44.551697 23611 tablet_replica.cc:330] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: stopping tablet replica
I20260807 00:37:44.551894 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23148
I20260807 00:37:44.552054 23313 ts_tablet_manager.cc:1905] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:44.554184 23611 raft_consensus.cc:2229] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:37:44.554363 23611 raft_consensus.cc:2258] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:44.557495 23612 tablet_replica.cc:330] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: stopping tablet replica
I20260807 00:37:44.557971 23611 ts_tablet_manager.cc:1905] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:44.558163 23612 raft_consensus.cc:2229] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:37:44.558363 23612 raft_consensus.cc:2258] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:37:44.559208 23612 ts_tablet_manager.cc:1905] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:37:44.560825 23612 ts_tablet_manager.cc:1918] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:44.560822 23611 ts_tablet_manager.cc:1918] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:37:44.560948 23612 log.cc:1196] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:44.560956 23611 log.cc:1196] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:44.561292 23612 ts_tablet_manager.cc:1939] T 81f2c13dcc1a4a42a1df05da65f61086 P b3c71d40b90b4139bff00eb65a2906f2: Deleting consensus metadata
I20260807 00:37:44.561388 23611 ts_tablet_manager.cc:1939] T 81f2c13dcc1a4a42a1df05da65f61086 P 37e58ef3b05249a08210aa4270691ef1: Deleting consensus metadata
I20260807 00:37:44.561854 23093 catalog_manager.cc:4841] TS b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): tablet 81f2c13dcc1a4a42a1df05da65f61086 (table test-table [id=df352473ba224fb29d4917e316e5a2f1]) successfully deleted
I20260807 00:37:44.561969 23093 catalog_manager.cc:4841] TS 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): tablet 81f2c13dcc1a4a42a1df05da65f61086 (table test-table [id=df352473ba224fb29d4917e316e5a2f1]) successfully deleted
W20260807 00:37:44.562129 23095 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:45885 (error 108)
W20260807 00:37:44.563728 23586 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:37:44.562589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45885 (local address 127.0.0.1:60172)
0807 00:37:44.562687 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.562703 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.562758 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:44.563671 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45885: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 00:37:44.564198 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23310
W20260807 00:37:44.563872 23095 catalog_manager.cc:4584] TS 3a6255000899469d9db040b5f80dc3b8 (127.7.252.1:45885): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 81f2c13dcc1a4a42a1df05da65f61086: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45885: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 00:37:44.571376 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23448
I20260807 00:37:44.580782 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23075
I20260807 00:37:44.587404 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44809
--webserver_interface=127.7.252.62
--webserver_port=41205
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44809
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:44.671984 23614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:44.672223 23614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:44.672256 23614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:44.673501 23614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:37:44.673549 23614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:44.673564 23614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:44.673576 23614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:37:44.673589 23614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:37:44.675194 23614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=41205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:44.675490 23614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:44.675734 23614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:44.681329 23619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.681393 23622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.681370 23614 server_base.cc:1034] running on GCE node
W20260807 00:37:44.681375 23620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.681794 23614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:44.682099 23614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:44.683331 23614 hybrid_clock.cc:648] HybridClock initialized: now 1786063064683311 us; error 69 us; skew 500 ppm
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:44.686339 23614 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:37:44.686990 23614 webserver.cc:460] Webserver started at http://127.7.252.62:41205/ using document root <none> and password file <none>
I20260807 00:37:44.687295 23614 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:44.687376 23614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:44.688910 23614 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:44.689827 23629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.690104 23614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.690385 23614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "9eb3fc501279432281a4ceab79622c09"
format_stamp: "Formatted at 2026-08-07 00:37:42 on dist-test-slave-csg5"
server_key: "de14b1dbfa13cd43008c440a05c2bb72"
server_key_iv: "72ed4656ad435768c066c43b8651df7b"
server_key_version: "encryptionkey@0"
I20260807 00:37:44.690899 23614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:44.711592 23614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:44.714229 23614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:44.714545 23614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:44.719045 23614 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44809
I20260807 00:37:44.719095 23684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44809 every 8 connection(s)
I20260807 00:37:44.719554 23614 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:37:44.721244 23685 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:37:44.721901 23685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap starting.
I20260807 00:37:44.723874 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23614
I20260807 00:37:44.724197 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:45885
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:44809
--webserver_port=45093
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:37:44.731346 23685 log.cc:824] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:44.733830 23685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:37:44.734174 23685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09: Bootstrap complete.
I20260807 00:37:44.736665 23685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.736948 23685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb3fc501279432281a4ceab79622c09, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.737135 23685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.737214 23685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:37:44.737268 23685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:37:44.737317 23685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 2 FOLLOWER]: Advancing to term 3
I20260807 00:37:44.738420 23685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.738547 23685 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eb3fc501279432281a4ceab79622c09; no voters:
I20260807 00:37:44.738785 23685 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 00:37:44.738828 23689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 00:37:44.738945 23689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [term 3 LEADER]: Becoming Leader. State: Replica: 9eb3fc501279432281a4ceab79622c09, State: Running, Role: LEADER
I20260807 00:37:44.739045 23689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } }
I20260807 00:37:44.739144 23685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:37:44.739374 23691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb3fc501279432281a4ceab79622c09. Latest consensus state: current_term: 3 leader_uuid: "9eb3fc501279432281a4ceab79622c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } } }
I20260807 00:37:44.739481 23691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:44.739364 23690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9eb3fc501279432281a4ceab79622c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fc501279432281a4ceab79622c09" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44809 } } }
I20260807 00:37:44.739810 23690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fc501279432281a4ceab79622c09 [sys.catalog]: This master's current role is: LEADER
I20260807 00:37:44.739912 23694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:37:44.740813 23694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:37:44.740931 23694 catalog_manager.cc:1259] Loaded cluster ID: 8677e5cb0f52474da5e1401824b5baf9
I20260807 00:37:44.740968 23694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 00:37:44.741312 23694 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3917df99ad google::LogMessage::Fail() at ??:0
@ 0x7f3917dfc88a google::LogMessage::SendToLog() at ??:0
@ 0x7f3917df94de google::LogMessage::Flush() at ??:0
@ 0x7f3917dfaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f391fd1a0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f391fd238b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3919cc70d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3919cbc954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f391ab206db start_thread at ??:0
@ 0x7f39168f761f clone at ??:0
W20260807 00:37:44.848757 23687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:44.849123 23687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:44.849169 23687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:44.851153 23687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:44.851223 23687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:44.851259 23687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:37:44.853257 23687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:45885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=45093
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:44.853567 23687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:44.853845 23687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:44.859695 23723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.859696 23725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:44.859720 23722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:44.860498 23687 server_base.cc:1034] running on GCE node
I20260807 00:37:44.860761 23687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:44.861057 23687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:44.862319 23687 hybrid_clock.cc:648] HybridClock initialized: now 1786063064862310 us; error 38 us; skew 500 ppm
Aug 07 00:37:44 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:44.865501 23687 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:37:44.866199 23687 webserver.cc:460] Webserver started at http://127.7.252.1:45093/ using document root <none> and password file <none>
I20260807 00:37:44.866525 23687 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:44.866616 23687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:44.868932 23687 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:37:44.870039 23733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:44.870397 23687 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:44.870518 23687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "3a6255000899469d9db040b5f80dc3b8"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "e71a15e2814929977f7d7d21e5c68edd"
server_key_iv: "9060dbbe93462d54ba494593de04ea78"
server_key_version: "encryptionkey@0"
I20260807 00:37:44.871133 23687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:44.921095 23687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:44.924137 23687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:44.924418 23687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:44.924710 23687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:44.925251 23740 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 00:37:44.927680 23687 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 00:37:44.927789 23687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260807 00:37:44.927860 23687 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 00:37:44.928606 23687 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 00:37:44.928665 23687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 00:37:44.928778 23740 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap starting.
I20260807 00:37:44.931011 23740 log.cc:824] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Log is configured to *not* fsync() on all Append() calls
I20260807 00:37:44.934396 23740 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:37:44.934800 23740 tablet_bootstrap.cc:492] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Bootstrap complete.
I20260807 00:37:44.934993 23740 ts_tablet_manager.cc:1397] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260807 00:37:44.936213 23687 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:45885
I20260807 00:37:44.936252 23853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:45885 every 8 connection(s)
I20260807 00:37:44.936616 23687 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:37:44.936976 23740 raft_consensus.cc:348] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.937363 23740 raft_consensus.cc:729] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6255000899469d9db040b5f80dc3b8, State: Initialized, Role: FOLLOWER
I20260807 00:37:44.937513 23740 consensus_queue.cc:260] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:44.937786 23740 ts_tablet_manager.cc:1428] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 00:37:44.941861 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23687
I20260807 00:37:44.942214 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:43043
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:44809
--webserver_port=34979
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:45.014564 23856 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:37:44.937398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:56317)
0807 00:37:44.937717 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:44.937761 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:44.937928 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:45.014296 (+ 76368us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":89,"threads_started":1}
W20260807 00:37:45.014844 23854 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:44809 (0 consecutive failures): Network error: Failed to ping master at 127.7.252.62:44809: Client connection negotiation failed: client connection to 127.7.252.62:44809: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 00:37:45.015271 23856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.015134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:41227)
0807 00:37:45.015197 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.015241 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 00:37:45.015779 23856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.015642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:41517)
0807 00:37:45.015701 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.015747 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 00:37:45.015946 23854 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 00:37:45.054647 23858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:45.054942 23858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:45.054971 23858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:45.056269 23858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:45.056314 23858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:45.056344 23858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:37:45.057950 23858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:43043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=34979
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:45.058225 23858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:45.058506 23858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:45.063978 23866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:45.063971 23863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:45.063998 23864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:45.064478 23858 server_base.cc:1034] running on GCE node
I20260807 00:37:45.064740 23858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:45.065039 23858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:45.066316 23858 hybrid_clock.cc:648] HybridClock initialized: now 1786063065066338 us; error 68 us; skew 500 ppm
Aug 07 00:37:45 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063065, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:45.069568 23858 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:37:45.070065 23858 webserver.cc:460] Webserver started at http://127.7.252.2:34979/ using document root <none> and password file <none>
I20260807 00:37:45.070326 23858 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:45.070398 23858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:45.071997 23858 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:45.072784 23873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:45.073001 23858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:45.073107 23858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "b3c71d40b90b4139bff00eb65a2906f2"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "07359a3280fa1f92540ab58dca18e64d"
server_key_iv: "ecc3bff89827f8cf822c93125ffb0529"
server_key_version: "encryptionkey@0"
I20260807 00:37:45.073534 23858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:45.090070 23858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:45.092873 23858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:45.093063 23858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:45.093336 23858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:45.093679 23858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:45.093731 23858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:45.093777 23858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:45.093822 23858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:45.100198 23858 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:43043
I20260807 00:37:45.100303 23991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:43043 every 8 connection(s)
I20260807 00:37:45.100646 23858 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:37:45.101779 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.101398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:54333)
0807 00:37:45.101551 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.101622 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
W20260807 00:37:45.102233 23992 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:44809 (0 consecutive failures): Network error: Failed to ping master at 127.7.252.62:44809: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
I20260807 00:37:45.102586 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.102468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:39585)
0807 00:37:45.102531 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.102564 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 00:37:45.102953 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.102872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:46311)
0807 00:37:45.102912 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.102936 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 00:37:45.103080 23992 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 00:37:45.109596 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23858
I20260807 00:37:45.109894 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:40791
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:44809
--webserver_port=36169
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:37:45.195169 23995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:37:45.195391 23995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:37:45.195416 23995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:37:45.196616 23995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:37:45.196662 23995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:37:45.196691 23995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:37:45.198179 23995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:40791
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=36169
--tserver_master_addrs=127.7.252.62:44809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:37:45.198436 23995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:37:45.198722 23995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:37:45.204146 24003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:45.204193 24001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:37:45.204275 24000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:37:45.204493 23995 server_base.cc:1034] running on GCE node
I20260807 00:37:45.204787 23995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:37:45.205076 23995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:37:45.206281 23995 hybrid_clock.cc:648] HybridClock initialized: now 1786063065206254 us; error 47 us; skew 500 ppm
Aug 07 00:37:45 dist-test-slave-csg5 krb5kdc[22508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063065, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:37:45.209116 23995 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:37:45.209661 23995 webserver.cc:460] Webserver started at http://127.7.252.3:36169/ using document root <none> and password file <none>
I20260807 00:37:45.209944 23995 fs_manager.cc:359] Metadata directory not provided
I20260807 00:37:45.210018 23995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:37:45.211697 23995 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:45.212407 24011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:45.212595 23995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:37:45.212743 23995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "37e58ef3b05249a08210aa4270691ef1"
format_stamp: "Formatted at 2026-08-07 00:37:43 on dist-test-slave-csg5"
server_key: "cef744f060715b8b7baca264d2009a03"
server_key_iv: "c0c35295485cd7032080d5fc806fefd6"
server_key_version: "encryptionkey@0"
I20260807 00:37:45.213145 23995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:37:45.229921 23995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:37:45.232622 23995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:37:45.232836 23995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:37:45.233122 23995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:37:45.233480 23995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:37:45.233534 23995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:45.233568 23995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:37:45.233597 23995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:37:45.239858 23995 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40791
I20260807 00:37:45.239908 24132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40791 every 8 connection(s)
I20260807 00:37:45.240289 23995 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:37:45.241457 24136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.241009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:35989)
0807 00:37:45.241207 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.241302 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
W20260807 00:37:45.242017 24134 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:44809 (0 consecutive failures): Network error: Failed to ping master at 127.7.252.62:44809: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
I20260807 00:37:45.242447 24136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.242256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:46183)
0807 00:37:45.242355 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.242423 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 00:37:45.242995 24136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:45.242866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:45603)
0807 00:37:45.242935 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:45.242967 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 00:37:45.243172 24134 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 00:37:45.246308 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 23995
I20260807 00:37:46.016744 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.016448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:48183)
0807 00:37:46.016620 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:46.016673 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":71,"threads_started":1}
I20260807 00:37:46.103758 24140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.103498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:53939)
0807 00:37:46.103641 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:46.103685 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260807 00:37:46.243878 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.243585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:48213)
0807 00:37:46.243764 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:46.243811 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":63,"threads_started":1}
I20260807 00:37:46.724016 24142 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:46.724152 24142 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:46.724570 24142 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
Aug 07 00:37:46 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.2@KRBTEST.COM
Aug 07 00:37:46 dist-test-slave-csg5 krb5kdc[22508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063064, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.3@KRBTEST.COM
I20260807 00:37:46.736896 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.725028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:43043 (local address 127.7.252.1:37515)
0807 00:37:46.725355 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:46.725366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:46.725428 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:46.726148 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:46.726151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:46.726762 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:46.727140 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:46.727143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.728234 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.728235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:46.729045 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:46.729047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.729690 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.729691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:46.729822 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:46.730450 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:46.730459 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:46.732296 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:46.735025 (+ 2729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:46.735026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:46.735319 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:46.735650 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:46.735651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:46.735784 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:46.736270 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:46.736271 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:46.736393 (+ 122us) client_negotiation.cc:769] Sending connection context
0807 00:37:46.736508 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 00:37:46.736748 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":9,"thread_start_us":62,"threads_started":1}
I20260807 00:37:46.736939 24145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.725007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:60497 (local address 127.7.252.3:40791)
0807 00:37:46.725255 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:46.725268 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:46.725301 (+ 33us) server_negotiation.cc:407] Connection header received
0807 00:37:46.725893 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:46.725896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:46.725989 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:46.726399 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:46.727138 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.728014 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.729159 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.729579 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.729708 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:46.732828 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:46.732832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:46.732833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:46.732844 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:46.734773 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735453 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:46.735457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:46.735457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:46.735554 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735863 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:46.735865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:46.735865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:46.736145 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:46.736213 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:46.736615 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 00:37:46.736804 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":76,"threads_started":1}
I20260807 00:37:46.737035 24143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.724837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40791 (local address 127.7.252.1:60497)
0807 00:37:46.724993 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:46.725005 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:37:46.725124 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:37:46.726160 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:37:46.726162 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:37:46.726764 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:37:46.726995 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:46.727002 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.728126 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.728129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:46.729043 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:37:46.729046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.729680 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.729682 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:37:46.729814 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:46.730512 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:37:46.730517 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:37:46.732692 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:37:46.734935 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:46.734947 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:46.734950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:46.735326 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:46.735637 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735638 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:37:46.735639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:37:46.735782 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:37:46.736228 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:37:46.736237 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:37:46.736394 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 00:37:46.736515 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 00:37:46.736877 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":189,"thread_start_us":71,"threads_started":1}
I20260807 00:37:46.737450 24147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:46.725216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:37515 (local address 127.7.252.2:43043)
0807 00:37:46.725396 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 00:37:46.725404 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:37:46.725422 (+ 18us) server_negotiation.cc:407] Connection header received
0807 00:37:46.725890 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:37:46.725892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:37:46.725936 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:37:46.726097 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:37:46.727262 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.728116 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.729143 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:37:46.729579 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:37:46.729715 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:37:46.732503 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:37:46.732509 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:37:46.732509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:37:46.732526 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:37:46.734897 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735422 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:46.735426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:46.735427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:46.735555 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:37:46.735863 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:37:46.735865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:37:46.735865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:37:46.736147 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:37:46.736272 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 00:37:46.737239 (+ 967us) server_negotiation.cc:299] Negotiation successful
0807 00:37:46.737364 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":55,"threads_started":1}
W20260807 00:37:46.738315 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
W20260807 00:37:46.738410 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:46.738430 23735 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8; no voters: 37e58ef3b05249a08210aa4270691ef1, b3c71d40b90b4139bff00eb65a2906f2
I20260807 00:37:46.738543 24142 raft_consensus.cc:2726] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:37:47.017591 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:47.017418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:44541)
0807 00:37:47.017499 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:47.017549 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 00:37:47.104635 24148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:47.104371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:57401)
0807 00:37:47.104532 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:47.104583 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
I20260807 00:37:47.245014 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:47.244702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:40685)
0807 00:37:47.244915 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:47.244964 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":100,"threads_started":1}
I20260807 00:37:48.018676 24150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:48.018253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:56329)
0807 00:37:48.018532 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:48.018582 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":100,"threads_started":1}
I20260807 00:37:48.105760 24151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:48.105329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:57491)
0807 00:37:48.105626 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:48.105689 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260807 00:37:48.246013 24152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:48.245773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:34469)
0807 00:37:48.245928 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:48.245963 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260807 00:37:48.495513 24153 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:48.495623 24153 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:48.495847 24153 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
W20260807 00:37:48.496323 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
W20260807 00:37:48.496443 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:48.496480 23735 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8; no voters: 37e58ef3b05249a08210aa4270691ef1, b3c71d40b90b4139bff00eb65a2906f2
I20260807 00:37:48.496582 24153 raft_consensus.cc:2726] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:37:49.019665 24154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:49.019406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:42425)
0807 00:37:49.019566 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:49.019613 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260807 00:37:49.106710 24155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:49.106347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:43903)
0807 00:37:49.106549 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:49.106597 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":125,"threads_started":1}
I20260807 00:37:49.246930 24156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:49.246611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:51121)
0807 00:37:49.246836 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:49.246881 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":133,"threads_started":1}
I20260807 00:37:50.020829 24157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:50.020530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:55453)
0807 00:37:50.020699 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:50.020765 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":69,"threads_started":1}
I20260807 00:37:50.107653 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:50.107372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:48883)
0807 00:37:50.107539 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:50.107600 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260807 00:37:50.247735 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:50.247483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:43837)
0807 00:37:50.247641 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:50.247687 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":66,"threads_started":1}
I20260807 00:37:51.021845 24160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:51.021544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:41493)
0807 00:37:51.021739 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:51.021789 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":115,"threads_started":1}
I20260807 00:37:51.108536 24161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:51.108244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:34471)
0807 00:37:51.108431 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:51.108475 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":105,"threads_started":1}
I20260807 00:37:51.239993 24162 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:51.240113 24162 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:51.240444 24162 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
W20260807 00:37:51.241000 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
W20260807 00:37:51.241086 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:51.241114 23735 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8; no voters: 37e58ef3b05249a08210aa4270691ef1, b3c71d40b90b4139bff00eb65a2906f2
I20260807 00:37:51.241211 24162 raft_consensus.cc:2726] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:37:51.248693 24163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:51.248427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:49569)
0807 00:37:51.248586 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:51.248636 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260807 00:37:52.022775 24164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:52.022482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:38685)
0807 00:37:52.022675 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:52.022723 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
I20260807 00:37:52.109454 24165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:52.109120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:48877)
0807 00:37:52.109342 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:52.109392 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":100,"threads_started":1}
I20260807 00:37:52.249733 24166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:52.249430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:48211)
0807 00:37:52.249621 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:52.249674 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":78,"threads_started":1}
I20260807 00:37:53.023932 24167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:53.023445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:43967)
0807 00:37:53.023611 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:53.023660 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":72,"threads_started":1}
I20260807 00:37:53.110409 24168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:53.110107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:35909)
0807 00:37:53.110312 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:53.110360 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
I20260807 00:37:53.250841 24169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:53.250563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:58181)
0807 00:37:53.250730 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:53.250790 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":76,"threads_started":1}
I20260807 00:37:53.275163 24170 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:53.275315 24170 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:53.275532 24170 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
W20260807 00:37:53.276057 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
W20260807 00:37:53.276158 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:53.276201 23735 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8; no voters: 37e58ef3b05249a08210aa4270691ef1, b3c71d40b90b4139bff00eb65a2906f2
I20260807 00:37:53.276279 24170 raft_consensus.cc:2726] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:37:54.024900 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:54.024613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:45633)
0807 00:37:54.024794 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:54.024847 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":70,"threads_started":1}
I20260807 00:37:54.111593 24172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:54.111234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:60011)
0807 00:37:54.111490 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:54.111542 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":79,"threads_started":1}
I20260807 00:37:54.251929 24173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:54.251631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:46137)
0807 00:37:54.251825 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:54.251876 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":85,"threads_started":1}
I20260807 00:37:55.025683 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:55.025440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:33091)
0807 00:37:55.025594 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:55.025632 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
I20260807 00:37:55.112538 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:55.112248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:47111)
0807 00:37:55.112442 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:55.112486 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":83,"threads_started":1}
I20260807 00:37:55.252846 24176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:55.252557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:37421)
0807 00:37:55.252747 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:55.252795 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":66,"threads_started":1}
I20260807 00:37:56.026587 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:56.026259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:50727)
0807 00:37:56.026479 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:56.026529 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":111,"threads_started":1}
I20260807 00:37:56.113577 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:56.113295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:56315)
0807 00:37:56.113476 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:56.113524 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":97,"threads_started":1}
I20260807 00:37:56.253805 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:56.253534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:48041)
0807 00:37:56.253704 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:56.253755 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":71,"threads_started":1}
I20260807 00:37:57.027673 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:57.027403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:50121)
0807 00:37:57.027577 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:57.027624 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":79,"threads_started":1}
I20260807 00:37:57.114646 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:57.114381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:39861)
0807 00:37:57.114545 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:57.114592 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260807 00:37:57.254925 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:57.254497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:46257)
0807 00:37:57.254810 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:57.254864 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":70,"threads_started":1}
I20260807 00:37:58.028609 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:58.028367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:42301)
0807 00:37:58.028512 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:58.028558 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260807 00:37:58.115645 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:58.115390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:53123)
0807 00:37:58.115549 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:58.115582 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260807 00:37:58.255695 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:58.255448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:33527)
0807 00:37:58.255607 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:58.255645 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260807 00:37:59.029502 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:59.029228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:41927)
0807 00:37:59.029402 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:59.029451 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":71,"threads_started":1}
I20260807 00:37:59.116806 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:59.116475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:42389)
0807 00:37:59.116703 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:59.116752 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":77,"threads_started":1}
I20260807 00:37:59.256745 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:37:59.256429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:57671)
0807 00:37:59.256625 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 00:37:59.256692 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":91,"threads_started":1}
I20260807 00:37:59.719340 24189 raft_consensus.cc:482] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:37:59.719566 24189 raft_consensus.cc:504] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e58ef3b05249a08210aa4270691ef1" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40791 } } peers { permanent_uuid: "b3c71d40b90b4139bff00eb65a2906f2" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 43043 } } peers { permanent_uuid: "3a6255000899469d9db040b5f80dc3b8" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45885 } }
I20260807 00:37:59.719885 24189 leader_election.cc:288] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791), b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043)
W20260807 00:37:59.720746 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37e58ef3b05249a08210aa4270691ef1 (127.7.252.3:40791): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
W20260807 00:37:59.720877 23735 leader_election.cc:341] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3c71d40b90b4139bff00eb65a2906f2 (127.7.252.2:43043): Not found: Tablet not found: 81f2c13dcc1a4a42a1df05da65f61086
I20260807 00:37:59.720901 23735 leader_election.cc:302] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a6255000899469d9db040b5f80dc3b8; no voters: 37e58ef3b05249a08210aa4270691ef1, b3c71d40b90b4139bff00eb65a2906f2
I20260807 00:37:59.721007 24189 raft_consensus.cc:2726] T 81f2c13dcc1a4a42a1df05da65f61086 P 3a6255000899469d9db040b5f80dc3b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:38:00.030601 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:00.030250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.1:40731)
0807 00:38:00.030479 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:00.030540 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":68,"threads_started":1}
I20260807 00:38:00.117862 24191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:00.117628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.2:51887)
0807 00:38:00.117767 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:00.117809 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":63,"threads_started":1}
I20260807 00:38:00.257661 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23687
I20260807 00:38:00.257836 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:00.257578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:44809 (local address 127.7.252.3:48813)
0807 00:38:00.257735 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:00.257781 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:44809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260807 00:38:00.264709 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23858
I20260807 00:38:00.271050 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 23995
2026-08-07T00:38:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18833 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:38:00 dist-test-slave-csg5 krb5kdc[24195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:38:00 dist-test-slave-csg5 krb5kdc[24195](info): set up 2 sockets
Aug 07 00:38:00 dist-test-slave-csg5 krb5kdc[24195](info): commencing operation
krb5kdc: starting...
W20260807 00:38:01.400425 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:38:01 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:38:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:38:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:38:01.546541 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35913
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:35913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:01.636984 24208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:01.637262 24208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:01.637305 24208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:01.638608 24208 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 00:38:01.638722 24208 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 00:38:01.638748 24208 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 00:38:01.638770 24208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:38:01.638800 24208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:01.638834 24208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:01.638860 24208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:38:01.638888 24208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:38:01.640622 24208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:35913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:01.641021 24208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:01.641507 24208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:01.647636 24214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:01.647678 24213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:01.647703 24216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:01.647671 24208 server_base.cc:1034] running on GCE node
I20260807 00:38:01.648391 24208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:01.648778 24208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:01.649986 24208 hybrid_clock.cc:648] HybridClock initialized: now 1786063081649961 us; error 42 us; skew 500 ppm
Aug 07 00:38:01 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063081, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:01.653514 24208 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:38:01.654080 24208 webserver.cc:460] Webserver started at http://127.7.252.62:46323/ using document root <none> and password file <none>
I20260807 00:38:01.654493 24208 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:01.654578 24208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:01.654771 24208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:38:01.655958 24208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "63cd790d7e0242cfb2903b6b0a623109"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "b174cccc2ae2c77a6a774f9c41c2105a"
server_key_iv: "cbdc81f88807619269e42b6585ea247e"
server_key_version: "encryptionkey@0"
I20260807 00:38:01.656354 24208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "63cd790d7e0242cfb2903b6b0a623109"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "b174cccc2ae2c77a6a774f9c41c2105a"
server_key_iv: "cbdc81f88807619269e42b6585ea247e"
server_key_version: "encryptionkey@0"
I20260807 00:38:01.657974 24208 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:38:01.659312 24223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:01.659538 24208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:01.659644 24208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "63cd790d7e0242cfb2903b6b0a623109"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "b174cccc2ae2c77a6a774f9c41c2105a"
server_key_iv: "cbdc81f88807619269e42b6585ea247e"
server_key_version: "encryptionkey@0"
I20260807 00:38:01.659742 24208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:01.684695 24208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:01.687608 24208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:01.687819 24208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:01.692708 24208 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:35913
I20260807 00:38:01.692756 24279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:35913 every 8 connection(s)
I20260807 00:38:01.693179 24208 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:38:01.693372 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 24208
I20260807 00:38:01.693478 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:38:01.693738 8176 external_mini_cluster.cc:1428] Setting key 9b5ee6e600c8ed50405d65b66be83a70
I20260807 00:38:01.694576 24280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:01.697911 24280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap starting.
I20260807 00:38:01.698793 24280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:01.699147 24280 log.cc:824] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:01.700178 24280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: No bootstrap required, opened a new log
Aug 07 00:38:01 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:01.703122 24280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:01.703323 24280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:01.703352 24280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cd790d7e0242cfb2903b6b0a623109, State: Initialized, Role: FOLLOWER
I20260807 00:38:01.703516 24280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:01.703611 24280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:38:01.703639 24280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:38:01.703750 24280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:01.704490 24280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:01.704634 24280 leader_election.cc:302] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63cd790d7e0242cfb2903b6b0a623109; no voters:
I20260807 00:38:01.704903 24280 leader_election.cc:288] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:38:01.704939 24285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:38:01.705116 24285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 LEADER]: Becoming Leader. State: Replica: 63cd790d7e0242cfb2903b6b0a623109, State: Running, Role: LEADER
I20260807 00:38:01.705324 24280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:38:01.705291 24285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:01.705978 24287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63cd790d7e0242cfb2903b6b0a623109. Latest consensus state: current_term: 1 leader_uuid: "63cd790d7e0242cfb2903b6b0a623109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } } }
I20260807 00:38:01.706193 24287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: This master's current role is: LEADER
I20260807 00:38:01.706465 24295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:38:01.707159 24295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:38:01.707190 24286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63cd790d7e0242cfb2903b6b0a623109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } } }
I20260807 00:38:01.707315 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:01.694502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55650 (local address 127.7.252.62:35913)
0807 00:38:01.694737 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:01.694749 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:01.694946 (+ 197us) server_negotiation.cc:407] Connection header received
0807 00:38:01.695507 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:01.695515 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:01.695570 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:01.695752 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:01.696490 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:01.697599 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:01.698516 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:01.699128 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:01.699304 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:01.702451 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:01.702456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:01.702456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:01.702470 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:01.704883 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:01.705390 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:01.705394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:01.705394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:01.705557 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:01.705905 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:01.705907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:01.705907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:01.706291 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:01.706459 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:01.706806 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 00:38:01.707008 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":120,"threads_started":1}
I20260807 00:38:01.707412 24286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: This master's current role is: LEADER
I20260807 00:38:01.709576 24295 catalog_manager.cc:1347] Generated new cluster ID: 16163cfed85f4814874002c93cee07e6
I20260807 00:38:01.709645 24295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:38:01.744059 24295 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:38:01.744830 24295 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:38:01.754637 24295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Generated new TSK 0
I20260807 00:38:01.754987 24295 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:38:01.799669 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35913
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:01.891456 24309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:01.891748 24309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:01.891803 24309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:01.893177 24309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:01.893265 24309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:01.893312 24309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:38:01.895915 24309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:01.896281 24309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:01.896669 24309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:38:01.904091 24309 server_base.cc:1034] running on GCE node
W20260807 00:38:01.904047 24316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:01.904011 24315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:01.904047 24318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:01.904788 24309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:01.905252 24309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:01.906773 24309 hybrid_clock.cc:648] HybridClock initialized: now 1786063081906750 us; error 78 us; skew 500 ppm
Aug 07 00:38:01 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063081, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:01.909827 24309 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:38:01.910362 24309 webserver.cc:460] Webserver started at http://127.7.252.1:33145/ using document root <none> and password file <none>
I20260807 00:38:01.910625 24309 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:01.910720 24309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:01.910946 24309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:38:01.912087 24309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "0dad5957b50340bf9c54823abf00b366"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "15f3384d645a2f0fed22484040f8966a"
server_key_iv: "c0e7d0728e64c9b07de06bf545061856"
server_key_version: "encryptionkey@0"
I20260807 00:38:01.912467 24309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "0dad5957b50340bf9c54823abf00b366"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "15f3384d645a2f0fed22484040f8966a"
server_key_iv: "c0e7d0728e64c9b07de06bf545061856"
server_key_version: "encryptionkey@0"
I20260807 00:38:01.914028 24309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:38:01.915032 24325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:01.915369 24309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:01.915512 24309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "0dad5957b50340bf9c54823abf00b366"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "15f3384d645a2f0fed22484040f8966a"
server_key_iv: "c0e7d0728e64c9b07de06bf545061856"
server_key_version: "encryptionkey@0"
I20260807 00:38:01.915607 24309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:01.927176 24309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:01.929687 24309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:01.929939 24309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:01.930227 24309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:01.930603 24309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:01.930665 24309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:01.930763 24309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:01.930794 24309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:01.937225 24309 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42339
I20260807 00:38:01.937268 24443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42339 every 8 connection(s)
I20260807 00:38:01.937681 24309 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
Aug 07 00:38:01 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063081, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:01.946954 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 24309
I20260807 00:38:01.947101 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:38:01.947414 8176 external_mini_cluster.cc:1428] Setting key 3fd912674e700525c708626a6ad2bc40
I20260807 00:38:01.950363 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:01.938613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:52845 (local address 127.7.252.62:35913)
0807 00:38:01.938767 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:01.938770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:01.938979 (+ 209us) server_negotiation.cc:407] Connection header received
0807 00:38:01.939600 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:01.939601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:01.939623 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:01.939695 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:01.940983 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:01.941535 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:01.942831 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:01.943085 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:01.943165 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:01.945925 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:01.945926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:01.945926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:01.945935 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:01.948356 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:01.949153 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:01.949154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:01.949155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:01.949216 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:01.949583 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:01.949584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:01.949584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:01.949724 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:01.949787 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:01.950171 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 00:38:01.950271 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260807 00:38:01.950727 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:01.938555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:52845)
0807 00:38:01.938773 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:01.938830 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:01.939453 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:01.939863 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:01.939867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:01.940602 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:01.940852 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:01.940857 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:01.941656 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:01.941658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:01.942643 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:01.942646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:01.943198 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:01.943199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:01.943346 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:01.944057 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:01.944067 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:01.945792 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:01.948546 (+ 2754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:01.948562 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:01.948565 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:01.949038 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:01.949298 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:01.949299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:01.949299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:01.949478 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:01.949799 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:01.949807 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:01.950017 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 00:38:01.950144 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 00:38:01.950393 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":90,"threads_started":1}
I20260807 00:38:01.951386 24444 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35913
I20260807 00:38:01.951521 24444 heartbeater.cc:464] Registering TS with master...
I20260807 00:38:01.951743 24444 heartbeater.cc:511] Master 127.7.252.62:35913 requested a full tablet report, sending...
I20260807 00:38:01.952394 24238 ts_manager.cc:194] Registered new tserver with Master: 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339)
I20260807 00:38:01.953348 24238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:52845
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:38:01.984395 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35913
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:02.075829 24449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:02.076066 24449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:02.076092 24449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:02.077237 24449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:02.077275 24449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:02.077301 24449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:38:02.078785 24449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:02.079013 24449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:02.079205 24449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:02.084926 24454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:02.085043 24455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:02.084925 24457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:02.085223 24449 server_base.cc:1034] running on GCE node
I20260807 00:38:02.085472 24449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:02.085741 24449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:02.086988 24449 hybrid_clock.cc:648] HybridClock initialized: now 1786063082086980 us; error 37 us; skew 500 ppm
Aug 07 00:38:02 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063082, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:02.089923 24449 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:38:02.090426 24449 webserver.cc:460] Webserver started at http://127.7.252.2:40821/ using document root <none> and password file <none>
I20260807 00:38:02.090714 24449 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:02.090787 24449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:02.090915 24449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:38:02.091976 24449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "ffc1b45415d04290be8a6fb7d8810ac7"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "2008cd2720d16c356bc1ef702c91cb0b"
server_key_iv: "91ac4ced41eddba441331cdc4722736b"
server_key_version: "encryptionkey@0"
I20260807 00:38:02.092399 24449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "ffc1b45415d04290be8a6fb7d8810ac7"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "2008cd2720d16c356bc1ef702c91cb0b"
server_key_iv: "91ac4ced41eddba441331cdc4722736b"
server_key_version: "encryptionkey@0"
I20260807 00:38:02.093788 24449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:38:02.094816 24464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:02.095124 24449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:38:02.095244 24449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "ffc1b45415d04290be8a6fb7d8810ac7"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "2008cd2720d16c356bc1ef702c91cb0b"
server_key_iv: "91ac4ced41eddba441331cdc4722736b"
server_key_version: "encryptionkey@0"
I20260807 00:38:02.095329 24449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:02.107511 24449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:02.110137 24449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:02.110333 24449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:02.110636 24449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:02.111058 24449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:02.111119 24449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:02.111162 24449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:02.111188 24449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:02.117537 24449 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:37697
I20260807 00:38:02.117622 24586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:37697 every 8 connection(s)
I20260807 00:38:02.118009 24449 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:38:02.121593 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 24449
I20260807 00:38:02.121713 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:38:02.121982 8176 external_mini_cluster.cc:1428] Setting key 0a22e70d0afb461f41ebc55a06bbe121
Aug 07 00:38:02 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063082, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:02.129463 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.118949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:54067 (local address 127.7.252.62:35913)
0807 00:38:02.119010 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.119013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.119291 (+ 278us) server_negotiation.cc:407] Connection header received
0807 00:38:02.119939 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.119940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.119955 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.120025 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:02.121175 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.121748 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.123306 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.123519 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.123599 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.126172 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:02.126174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:02.126175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:02.126183 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:02.127910 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:02.128411 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:02.128413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:02.128413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:02.128476 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:02.128744 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:02.128745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:02.128745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:02.128871 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:02.128949 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.129264 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.129354 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 00:38:02.129669 24589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.118917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:54067)
0807 00:38:02.119141 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.119184 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.119807 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.120109 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.120114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.120800 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:02.121034 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.121040 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.121853 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.121854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.123207 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.123210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.123610 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.123611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.123759 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.124453 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:02.124466 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:02.126048 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:02.128038 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:02.128048 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:02.128051 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:02.128315 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:02.128549 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:02.128550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:02.128550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:02.128668 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:02.128969 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:02.128976 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:02.129120 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.129231 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.129412 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":117,"threads_started":1}
I20260807 00:38:02.130460 24587 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35913
I20260807 00:38:02.130569 24587 heartbeater.cc:464] Registering TS with master...
I20260807 00:38:02.130905 24587 heartbeater.cc:511] Master 127.7.252.62:35913 requested a full tablet report, sending...
I20260807 00:38:02.131419 24238 ts_manager.cc:194] Registered new tserver with Master: ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
I20260807 00:38:02.131841 24238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:54067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:38:02.159618 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35913
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:02.255144 24592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:02.255437 24592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:02.255482 24592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:02.256783 24592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:02.256863 24592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:02.256913 24592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:38:02.258581 24592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:02.258917 24592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:02.259187 24592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:02.265195 24598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:02.265214 24597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:02.265187 24600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:02.265266 24592 server_base.cc:1034] running on GCE node
I20260807 00:38:02.265725 24592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:02.266005 24592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:02.267212 24592 hybrid_clock.cc:648] HybridClock initialized: now 1786063082267202 us; error 42 us; skew 500 ppm
Aug 07 00:38:02 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063082, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:02.270200 24592 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:38:02.270906 24592 webserver.cc:460] Webserver started at http://127.7.252.3:45887/ using document root <none> and password file <none>
I20260807 00:38:02.271184 24592 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:02.271258 24592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:02.271443 24592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:38:02.272576 24592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "bc2df90fd85c46289c42f32a3a505d82"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "ed7d5b12cfed2b0ae52239c67abf3f35"
server_key_iv: "50a619ec61107840cf6f9f045cc9f6cd"
server_key_version: "encryptionkey@0"
I20260807 00:38:02.272964 24592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "bc2df90fd85c46289c42f32a3a505d82"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "ed7d5b12cfed2b0ae52239c67abf3f35"
server_key_iv: "50a619ec61107840cf6f9f045cc9f6cd"
server_key_version: "encryptionkey@0"
I20260807 00:38:02.274578 24592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:38:02.275573 24609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:02.275802 24592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:38:02.275921 24592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "bc2df90fd85c46289c42f32a3a505d82"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "ed7d5b12cfed2b0ae52239c67abf3f35"
server_key_iv: "50a619ec61107840cf6f9f045cc9f6cd"
server_key_version: "encryptionkey@0"
I20260807 00:38:02.276008 24592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:02.309948 24592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:02.312400 24592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:02.312583 24592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:02.312853 24592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:02.313186 24592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:02.313242 24592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:02.313321 24592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:02.313354 24592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:02.320013 24592 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40621
I20260807 00:38:02.320092 24728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40621 every 8 connection(s)
I20260807 00:38:02.320494 24592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:38:02 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063082, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:02.328066 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 24592
I20260807 00:38:02.328212 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:38:02.328439 8176 external_mini_cluster.cc:1428] Setting key c7577138e5c70120cf0813ec5095151f
I20260807 00:38:02.331157 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.321458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:52027 (local address 127.7.252.62:35913)
0807 00:38:02.321659 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.321661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.321850 (+ 189us) server_negotiation.cc:407] Connection header received
0807 00:38:02.322427 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.322429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.322442 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.322498 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:02.323553 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.324081 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.325173 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.325384 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.325461 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.327872 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:02.327874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:02.327874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:02.327883 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:02.329588 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:02.330034 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:02.330036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:02.330036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:02.330101 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:02.330457 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:02.330458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:02.330458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:02.330587 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:02.330684 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.330973 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.331058 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260807 00:38:02.331388 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.321368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:52027)
0807 00:38:02.321696 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.321750 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.322303 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.322581 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.322585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.323216 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:02.323437 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.323442 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.324205 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.324206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.325051 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.325053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.325468 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.325469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.325601 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.326182 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:02.326191 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:02.327757 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:02.329703 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:02.329710 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:02.329713 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:02.329955 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:02.330172 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:02.330172 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:02.330173 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:02.330294 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:02.330680 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:02.330688 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:02.330835 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.330952 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.331125 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":94,"threads_started":1}
I20260807 00:38:02.331970 24729 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35913
I20260807 00:38:02.332075 24729 heartbeater.cc:464] Registering TS with master...
I20260807 00:38:02.332273 24729 heartbeater.cc:511] Master 127.7.252.62:35913 requested a full tablet report, sending...
I20260807 00:38:02.332700 24238 ts_manager.cc:194] Registered new tserver with Master: bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621)
I20260807 00:38:02.333137 24238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:52027
I20260807 00:38:02.340758 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:38:02.351553 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.342600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55664 (local address 127.7.252.62:35913)
0807 00:38:02.342698 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.342701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.342874 (+ 173us) server_negotiation.cc:407] Connection header received
0807 00:38:02.342907 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.342908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.342921 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.342988 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:02.343680 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.344232 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.345203 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.345503 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.345575 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.347227 (+ 1652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:02.347229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:02.347229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:02.347238 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:02.349582 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:02.350023 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:02.350025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:02.350025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:02.350119 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:02.350560 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:02.350561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:02.350561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:02.350931 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:02.351073 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.351281 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.351397 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:38:02.356387 24238 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:38:02.358331 24238 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:38:02.366858 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.361770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:37697 (local address 127.0.0.1:36756)
0807 00:38:02.362497 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.362507 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.362572 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.362906 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.362909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.362912 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:02.363007 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.363009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.364138 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.364140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.365471 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.365475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.366457 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.366459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.366546 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.366564 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.366616 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.366711 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":150,"threads_started":1}
I20260807 00:38:02.366887 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.362286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60802 (local address 127.7.252.3:40621)
0807 00:38:02.362877 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.362882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.362893 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:38:02.362935 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.362937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.362952 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.363036 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:02.363261 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.364608 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.365815 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.366341 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.366438 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.366507 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.366740 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.366783 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":193,"threads_started":1}
I20260807 00:38:02.366856 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.362074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40621 (local address 127.0.0.1:60802)
0807 00:38:02.362646 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.362682 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.362732 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.363118 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.363119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.363121 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:02.363166 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.363167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.364758 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.364760 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.365698 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.365701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.366453 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.366454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.366547 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.366564 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.366669 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.366747 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":82,"threads_started":1}
I20260807 00:38:02.367027 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.361770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42339 (local address 127.0.0.1:50532)
0807 00:38:02.362239 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.362289 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.362369 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.362987 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.362988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.363003 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:02.363072 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.363073 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.364635 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.364636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.365833 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.365835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.366818 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.366819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.366880 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.366885 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.366915 (+ 30us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.366955 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":48,"thread_start_us":96,"threads_started":1}
I20260807 00:38:02.367280 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.362071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36756 (local address 127.7.252.2:37697)
0807 00:38:02.362262 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.362268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.362603 (+ 335us) server_negotiation.cc:407] Connection header received
0807 00:38:02.362742 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.362745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.362766 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.363089 (+ 323us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:02.363175 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.364031 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.365578 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.366346 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.367014 (+ 668us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.367088 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.367116 (+ 28us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.367168 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":104,"threads_started":1}
I20260807 00:38:02.367630 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.361977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50532 (local address 127.7.252.1:42339)
0807 00:38:02.362780 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.362786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.362797 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:38:02.362851 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.362853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.362869 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.363158 (+ 289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:02.363285 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.364517 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.365927 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.366720 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.367453 (+ 733us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.367504 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.367526 (+ 22us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.367567 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":757,"thread_start_us":117,"threads_started":1}
I20260807 00:38:02.368070 24658 tablet_service.cc:1467] Processing CreateTablet for tablet 433f448ad81140498a36893bcdc089c7 (DEFAULT_TABLE table=test-table [id=607bd9c778fc4946819316eb0d662eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:38:02.368247 24374 tablet_service.cc:1467] Processing CreateTablet for tablet 433f448ad81140498a36893bcdc089c7 (DEFAULT_TABLE table=test-table [id=607bd9c778fc4946819316eb0d662eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:38:02.368518 24658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433f448ad81140498a36893bcdc089c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:02.368611 24374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433f448ad81140498a36893bcdc089c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:02.371526 24748 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Bootstrap starting.
I20260807 00:38:02.372025 24517 tablet_service.cc:1467] Processing CreateTablet for tablet 433f448ad81140498a36893bcdc089c7 (DEFAULT_TABLE table=test-table [id=607bd9c778fc4946819316eb0d662eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:38:02.372356 24748 tablet_bootstrap.cc:654] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:02.372424 24517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433f448ad81140498a36893bcdc089c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:02.373034 24748 log.cc:824] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:02.373435 24747 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Bootstrap starting.
I20260807 00:38:02.374202 24747 tablet_bootstrap.cc:654] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:02.374893 24747 log.cc:824] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:02.375113 24748 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: No bootstrap required, opened a new log
I20260807 00:38:02.375206 24748 ts_tablet_manager.cc:1397] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 00:38:02.376008 24747 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: No bootstrap required, opened a new log
I20260807 00:38:02.376086 24747 ts_tablet_manager.cc:1397] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:38:02.376356 24751 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Bootstrap starting.
I20260807 00:38:02.377115 24751 tablet_bootstrap.cc:654] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:02.377385 24748 raft_consensus.cc:348] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.377609 24748 raft_consensus.cc:374] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:02.377652 24748 raft_consensus.cc:729] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc2df90fd85c46289c42f32a3a505d82, State: Initialized, Role: FOLLOWER
I20260807 00:38:02.377712 24751 log.cc:824] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:02.377815 24748 consensus_queue.cc:260] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.378155 24729 heartbeater.cc:503] Master 127.7.252.62:35913 was elected leader, sending a full tablet report...
I20260807 00:38:02.378048 24747 raft_consensus.cc:348] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.378136 24748 ts_tablet_manager.cc:1428] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:38:02.378240 24747 raft_consensus.cc:374] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:02.378300 24747 raft_consensus.cc:729] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad5957b50340bf9c54823abf00b366, State: Initialized, Role: FOLLOWER
I20260807 00:38:02.378435 24747 consensus_queue.cc:260] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.378834 24751 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: No bootstrap required, opened a new log
I20260807 00:38:02.378895 24747 ts_tablet_manager.cc:1428] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:38:02.378919 24444 heartbeater.cc:503] Master 127.7.252.62:35913 was elected leader, sending a full tablet report...
I20260807 00:38:02.378919 24751 ts_tablet_manager.cc:1397] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:38:02.380975 24751 raft_consensus.cc:348] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.381145 24751 raft_consensus.cc:374] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:02.381194 24751 raft_consensus.cc:729] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc1b45415d04290be8a6fb7d8810ac7, State: Initialized, Role: FOLLOWER
I20260807 00:38:02.381310 24751 consensus_queue.cc:260] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.381603 24751 ts_tablet_manager.cc:1428] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:38:02.381696 24587 heartbeater.cc:503] Master 127.7.252.62:35913 was elected leader, sending a full tablet report...
W20260807 00:38:02.438547 24445 tablet.cc:2369] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:38:02.463213 24755 raft_consensus.cc:482] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:02.463393 24755 raft_consensus.cc:504] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.463903 24755 leader_election.cc:288] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339), bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621)
I20260807 00:38:02.467427 24756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.464164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40621 (local address 127.7.252.2:38937)
0807 00:38:02.464390 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.464401 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.464489 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.464710 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.464711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.464713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:02.464792 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.464793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.465557 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.465558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.466425 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.466428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.467151 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.467152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.467213 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.467216 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.467264 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.467298 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":15,"thread_start_us":148,"threads_started":1}
I20260807 00:38:02.467425 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.464221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:38937 (local address 127.7.252.3:40621)
0807 00:38:02.464310 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.464312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.464490 (+ 178us) server_negotiation.cc:407] Connection header received
0807 00:38:02.464615 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.464617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.464633 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.464695 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:02.464920 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.465464 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.466565 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.467060 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.467142 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.467153 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.467298 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.467346 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 00:38:02.467543 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.464227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58247 (local address 127.7.252.1:42339)
0807 00:38:02.464277 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.464279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.464290 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:38:02.464403 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.464404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.464416 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.464506 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:02.464710 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.465395 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.466509 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.466993 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.467056 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.467066 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.467406 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.467458 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:38:02.467586 24589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.464159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42339 (local address 127.7.252.2:58247)
0807 00:38:02.464229 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.464243 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:02.464312 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:02.464511 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:02.464513 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:02.464514 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:02.464592 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.464594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.465495 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.465497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.466395 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:02.466398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.467092 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.467093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:02.467186 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.467189 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:38:02.467378 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 00:38:02.467424 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":20}
I20260807 00:38:02.468081 24679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433f448ad81140498a36893bcdc089c7" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc2df90fd85c46289c42f32a3a505d82" is_pre_election: true
I20260807 00:38:02.468083 24396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433f448ad81140498a36893bcdc089c7" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad5957b50340bf9c54823abf00b366" is_pre_election: true
I20260807 00:38:02.468253 24679 raft_consensus.cc:2454] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 0.
I20260807 00:38:02.468266 24396 raft_consensus.cc:2454] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 0.
I20260807 00:38:02.468495 24466 leader_election.cc:302] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7; no voters:
I20260807 00:38:02.468644 24755 raft_consensus.cc:2781] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:38:02.468708 24755 raft_consensus.cc:482] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:38:02.468740 24755 raft_consensus.cc:3037] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:02.469487 24755 raft_consensus.cc:504] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.469645 24755 leader_election.cc:288] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339), bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621)
I20260807 00:38:02.469857 24679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433f448ad81140498a36893bcdc089c7" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc2df90fd85c46289c42f32a3a505d82"
I20260807 00:38:02.469899 24396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433f448ad81140498a36893bcdc089c7" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad5957b50340bf9c54823abf00b366"
I20260807 00:38:02.469959 24679 raft_consensus.cc:3037] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:02.469975 24396 raft_consensus.cc:3037] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:02.470994 24679 raft_consensus.cc:2454] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 1.
I20260807 00:38:02.470994 24396 raft_consensus.cc:2454] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 1.
I20260807 00:38:02.471228 24466 leader_election.cc:302] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7; no voters:
I20260807 00:38:02.471343 24755 raft_consensus.cc:2781] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:38:02.471498 24755 raft_consensus.cc:686] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 LEADER]: Becoming Leader. State: Replica: ffc1b45415d04290be8a6fb7d8810ac7, State: Running, Role: LEADER
I20260807 00:38:02.471599 24755 consensus_queue.cc:237] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:02.472564 24238 catalog_manager.cc:5495] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2). New cstate: current_term: 1 leader_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } health_report { overall_health: UNKNOWN } } }
I20260807 00:38:02.489367 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.486422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36758 (local address 127.7.252.2:37697)
0807 00:38:02.486505 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:02.486507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:02.486516 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:38:02.486566 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:02.486567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:02.486589 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:02.486825 (+ 236us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:38:02.487012 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.487555 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.488417 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:02.488636 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:02.488738 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:02.488940 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:38:02.489057 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:38:02.489160 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:02.489211 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 00:38:02.489236 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:38:02.491703 24679 raft_consensus.cc:1261] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Refusing update from remote peer ffc1b45415d04290be8a6fb7d8810ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:38:02.491703 24396 raft_consensus.cc:1261] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Refusing update from remote peer ffc1b45415d04290be8a6fb7d8810ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:38:02.492100 24755 consensus_queue.cc:1035] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:38:02.492367 24757 consensus_queue.cc:1035] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:38:02.495338 24761 mvcc.cc:205] Tried to move back new op lower bound from 7315714385882509312 to 7315714385804447744. Current Snapshot: MvccSnapshot[applied={T|T < 7315714385882509312}]
I20260807 00:38:02.495985 24762 mvcc.cc:205] Tried to move back new op lower bound from 7315714385882509312 to 7315714385804447744. Current Snapshot: MvccSnapshot[applied={T|T < 7315714385882509312}]
I20260807 00:38:02.498107 24238 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:38:02.498222 24238 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:38:02.499184 24238 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Sending DeleteTablet for 3 replicas of tablet 433f448ad81140498a36893bcdc089c7
I20260807 00:38:02.499601 24374 tablet_service.cc:1514] Processing DeleteTablet for tablet 433f448ad81140498a36893bcdc089c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:02 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:50532
I20260807 00:38:02.499585 24517 tablet_service.cc:1514] Processing DeleteTablet for tablet 433f448ad81140498a36893bcdc089c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:02 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36756
I20260807 00:38:02.499858 24658 tablet_service.cc:1514] Processing DeleteTablet for tablet 433f448ad81140498a36893bcdc089c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:02 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:60802
I20260807 00:38:02.499929 24770 tablet_replica.cc:330] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: stopping tablet replica
I20260807 00:38:02.499933 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 24309
I20260807 00:38:02.501574 24770 raft_consensus.cc:2229] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:38:02.501732 24770 raft_consensus.cc:2258] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:38:02.502390 24770 ts_tablet_manager.cc:1905] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:38:02.503363 24771 tablet_replica.cc:330] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: stopping tablet replica
I20260807 00:38:02.503551 24771 raft_consensus.cc:2229] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:38:02.503772 24771 raft_consensus.cc:2258] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:38:02.504347 24771 ts_tablet_manager.cc:1905] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:38:02.504678 24770 ts_tablet_manager.cc:1918] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:38:02.504814 24770 log.cc:1196] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/433f448ad81140498a36893bcdc089c7
I20260807 00:38:02.505267 24770 ts_tablet_manager.cc:1939] T 433f448ad81140498a36893bcdc089c7 P ffc1b45415d04290be8a6fb7d8810ac7: Deleting consensus metadata
I20260807 00:38:02.505925 24227 catalog_manager.cc:4841] TS ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): tablet 433f448ad81140498a36893bcdc089c7 (table test-table [id=607bd9c778fc4946819316eb0d662eb7]) successfully deleted
I20260807 00:38:02.506371 24771 ts_tablet_manager.cc:1918] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:38:02.506477 24771 log.cc:1196] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/433f448ad81140498a36893bcdc089c7
I20260807 00:38:02.506932 24771 ts_tablet_manager.cc:1939] T 433f448ad81140498a36893bcdc089c7 P bc2df90fd85c46289c42f32a3a505d82: Deleting consensus metadata
I20260807 00:38:02.507834 24225 catalog_manager.cc:4841] TS bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): tablet 433f448ad81140498a36893bcdc089c7 (table test-table [id=607bd9c778fc4946819316eb0d662eb7]) successfully deleted
W20260807 00:38:02.511356 24226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:42339 (error 108)
I20260807 00:38:02.511816 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 24449
I20260807 00:38:02.512017 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:02.511839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42339 (local address 127.0.0.1:50534)
0807 00:38:02.511918 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:02.511969 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 00:38:02.514402 24226 catalog_manager.cc:4584] TS 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 433f448ad81140498a36893bcdc089c7: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42339: connect: Connection refused (error 111)
I20260807 00:38:02.518486 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 24592
I20260807 00:38:02.525482 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 24208
I20260807 00:38:22.533900 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35913
--webserver_interface=127.7.252.62
--webserver_port=46323
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:35913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:22.619230 24773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:22.619474 24773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:22.619515 24773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:22.620749 24773 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 00:38:22.620820 24773 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 00:38:22.620842 24773 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 00:38:22.620877 24773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:38:22.620911 24773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:22.620941 24773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:22.620972 24773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:38:22.621002 24773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:38:22.623102 24773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:35913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=46323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:22.623416 24773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:22.623759 24773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:22.634483 24782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:22.634486 24780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:22.634581 24779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:22.634693 24773 server_base.cc:1034] running on GCE node
I20260807 00:38:22.635025 24773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:22.635432 24773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:22.636643 24773 hybrid_clock.cc:648] HybridClock initialized: now 1786063102636606 us; error 70 us; skew 500 ppm
Aug 07 00:38:22 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063102, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:22.644948 24773 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:38:22.645511 24773 webserver.cc:460] Webserver started at http://127.7.252.62:46323/ using document root <none> and password file <none>
I20260807 00:38:22.645776 24773 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:22.645874 24773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:22.647598 24773 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:22.648415 24789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:22.648630 24773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:22.648753 24773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "63cd790d7e0242cfb2903b6b0a623109"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "b174cccc2ae2c77a6a774f9c41c2105a"
server_key_iv: "cbdc81f88807619269e42b6585ea247e"
server_key_version: "encryptionkey@0"
I20260807 00:38:22.649200 24773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:22.665807 24773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:22.668663 24773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:22.668861 24773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:22.674168 24773 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:35913
I20260807 00:38:22.674204 24844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:35913 every 8 connection(s)
I20260807 00:38:22.674815 24773 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:38:22.676659 24845 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:38:22.677403 24845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap starting.
I20260807 00:38:22.680553 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 24773
I20260807 00:38:22.680909 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:42339
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:35913
--webserver_port=33145
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:38:22.688287 24845 log.cc:824] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:22.691489 24845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:38:22.691936 24845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap complete.
I20260807 00:38:22.695819 24845 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:22.696167 24845 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cd790d7e0242cfb2903b6b0a623109, State: Initialized, Role: FOLLOWER
I20260807 00:38:22.696390 24845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:22.696470 24845 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:38:22.696516 24845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:38:22.696565 24845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 1 FOLLOWER]: Advancing to term 2
I20260807 00:38:22.698027 24845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:22.698158 24845 leader_election.cc:302] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63cd790d7e0242cfb2903b6b0a623109; no voters:
I20260807 00:38:22.698349 24845 leader_election.cc:288] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 00:38:22.698473 24849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 00:38:22.698638 24845 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:38:22.698774 24849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 LEADER]: Becoming Leader. State: Replica: 63cd790d7e0242cfb2903b6b0a623109, State: Running, Role: LEADER
I20260807 00:38:22.698964 24849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:22.699357 24850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "63cd790d7e0242cfb2903b6b0a623109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } } }
I20260807 00:38:22.699451 24850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: This master's current role is: LEADER
I20260807 00:38:22.699941 24859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:38:22.700016 24851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63cd790d7e0242cfb2903b6b0a623109. Latest consensus state: current_term: 2 leader_uuid: "63cd790d7e0242cfb2903b6b0a623109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } } }
I20260807 00:38:22.700340 24851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: This master's current role is: LEADER
I20260807 00:38:22.701066 24859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:38:22.701207 24859 catalog_manager.cc:1259] Loaded cluster ID: 16163cfed85f4814874002c93cee07e6
I20260807 00:38:22.701247 24859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:38:22.702179 24859 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:38:22.702407 24859 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Loaded TSK: 0
I20260807 00:38:22.711179 24859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Generated new TSK 1
I20260807 00:38:22.711340 24859 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 00:38:22.785749 24847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:22.786010 24847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:22.786052 24847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:22.787392 24847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:22.787470 24847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:22.787518 24847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:38:22.789072 24847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:42339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=33145
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:22.789376 24847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:22.789638 24847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:22.795331 24873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:22.795457 24874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:22.795346 24876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:22.795588 24847 server_base.cc:1034] running on GCE node
I20260807 00:38:22.795965 24847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:22.796284 24847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:22.797492 24847 hybrid_clock.cc:648] HybridClock initialized: now 1786063102797467 us; error 48 us; skew 500 ppm
Aug 07 00:38:22 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063102, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:22.801127 24847 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:38:22.801788 24847 webserver.cc:460] Webserver started at http://127.7.252.1:33145/ using document root <none> and password file <none>
I20260807 00:38:22.802093 24847 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:22.802189 24847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:22.804409 24847 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:22.805369 24883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:22.805599 24847 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:22.805688 24847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "0dad5957b50340bf9c54823abf00b366"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "15f3384d645a2f0fed22484040f8966a"
server_key_iv: "c0e7d0728e64c9b07de06bf545061856"
server_key_version: "encryptionkey@0"
I20260807 00:38:22.806047 24847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:22.816465 24847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:22.819178 24847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:22.819427 24847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:22.819725 24847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:22.820261 24890 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 00:38:22.822427 24847 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 00:38:22.822516 24847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 00:38:22.822593 24847 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 00:38:22.823309 24847 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 00:38:22.823372 24847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 00:38:22.823454 24890 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Bootstrap starting.
I20260807 00:38:22.831074 24847 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42339
I20260807 00:38:22.831177 25003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42339 every 8 connection(s)
I20260807 00:38:22.831568 24847 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:38:22.835840 24890 log.cc:824] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:22.838210 24890 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:38:22.838577 24890 tablet_bootstrap.cc:492] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Bootstrap complete.
I20260807 00:38:22.838785 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 24847
I20260807 00:38:22.839071 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:37697
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:35913
--webserver_port=40821
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:38:22.839867 24890 ts_tablet_manager.cc:1397] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260807 00:38:22.841583 24890 raft_consensus.cc:348] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:22.842006 24890 raft_consensus.cc:729] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad5957b50340bf9c54823abf00b366, State: Initialized, Role: FOLLOWER
I20260807 00:38:22.842167 24890 consensus_queue.cc:260] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } } peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } }
I20260807 00:38:22.842489 24890 ts_tablet_manager.cc:1428] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
Aug 07 00:38:22 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063102, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:22.848852 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:22.832439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:34907)
0807 00:38:22.834949 (+ 2510us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:22.835000 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:22.835577 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:22.836119 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:22.836124 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:22.836493 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:22.836789 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:22.836796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.838751 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.838752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:22.840156 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:22.840161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.841326 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.841327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:22.841468 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:22.842237 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:22.842247 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:22.844343 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:22.846857 (+ 2514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:22.846868 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:22.846871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:22.847144 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:22.847463 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:22.847464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:22.847464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:22.847625 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:22.848090 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:22.848098 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:22.848261 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 00:38:22.848388 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 00:38:22.848609 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2466,"thread_start_us":103,"threads_started":1}
I20260807 00:38:22.848860 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:22.832534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:34907 (local address 127.7.252.62:35913)
0807 00:38:22.834838 (+ 2304us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:22.834849 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:22.835134 (+ 285us) server_negotiation.cc:407] Connection header received
0807 00:38:22.835813 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:22.835820 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:22.835877 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:22.836028 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:22.836950 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.838534 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.840283 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.841137 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.841254 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:22.844500 (+ 3246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:22.844505 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:22.844505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:22.844518 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:22.846746 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:22.847269 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:22.847272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:22.847272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:22.847374 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:22.847730 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:22.847731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:22.847732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:22.847997 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:22.848124 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:22.848469 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 00:38:22.848608 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2239,"thread_start_us":75,"threads_started":1}
I20260807 00:38:22.850028 25004 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35913
I20260807 00:38:22.850165 25004 heartbeater.cc:464] Registering TS with master...
I20260807 00:38:22.850369 25004 heartbeater.cc:511] Master 127.7.252.62:35913 requested a full tablet report, sending...
I20260807 00:38:22.851256 24807 ts_manager.cc:194] Registered new tserver with Master: 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339)
I20260807 00:38:22.852537 24807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:34907
I20260807 00:38:22.853641 25004 heartbeater.cc:503] Master 127.7.252.62:35913 was elected leader, sending a full tablet report...
I20260807 00:38:22.860797 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:22.852270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39626 (local address 127.7.252.1:42339)
0807 00:38:22.857285 (+ 5015us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:22.857290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:22.857297 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:38:22.857390 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:22.857392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:22.857405 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:22.857517 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:22.857757 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.858449 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.859626 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.860139 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.860233 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:22.860355 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:22.860648 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 00:38:22.860702 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4983,"thread_start_us":82,"threads_started":1}
I20260807 00:38:22.860805 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:22.851923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42339 (local address 127.0.0.1:39626)
0807 00:38:22.857026 (+ 5103us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:22.857070 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:22.857145 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:22.857539 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:22.857542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:22.857544 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:22.857665 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:22.857667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.858544 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.858545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:22.859511 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:22.859514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.860234 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.860235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:22.860352 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:22.860369 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 00:38:22.860620 (+ 251us) client_negotiation.cc:240] Negotiation successful
0807 00:38:22.860708 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5061,"thread_start_us":153,"threads_started":1}
I20260807 00:38:22.861734 24932 tablet_service.cc:1514] Processing DeleteTablet for tablet 433f448ad81140498a36893bcdc089c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:02 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:39626
I20260807 00:38:22.862342 25014 tablet_replica.cc:330] stopping tablet replica
I20260807 00:38:22.862498 25014 raft_consensus.cc:2229] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:38:22.862581 25014 raft_consensus.cc:2258] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:38:22.862998 25014 ts_tablet_manager.cc:1905] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:38:22.865459 25014 ts_tablet_manager.cc:1918] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:38:22.865571 25014 log.cc:1196] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal/wals/433f448ad81140498a36893bcdc089c7
I20260807 00:38:22.865850 25014 ts_tablet_manager.cc:1939] T 433f448ad81140498a36893bcdc089c7 P 0dad5957b50340bf9c54823abf00b366: Deleting consensus metadata
I20260807 00:38:22.866454 24792 catalog_manager.cc:4841] TS 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339): tablet 433f448ad81140498a36893bcdc089c7 (table test-table [id=607bd9c778fc4946819316eb0d662eb7]) successfully deleted
W20260807 00:38:22.942703 25010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:22.942976 25010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:22.943004 25010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:22.944286 25010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:22.944337 25010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:22.944367 25010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:38:22.945937 25010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:37697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=40821
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:22.946216 25010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:22.946491 25010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:22.952111 25020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:22.952116 25019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:22.952111 25022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:22.952490 25010 server_base.cc:1034] running on GCE node
I20260807 00:38:22.952807 25010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:22.953148 25010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:22.954383 25010 hybrid_clock.cc:648] HybridClock initialized: now 1786063102954360 us; error 43 us; skew 500 ppm
Aug 07 00:38:22 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063102, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:22.957221 25010 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:38:22.957751 25010 webserver.cc:460] Webserver started at http://127.7.252.2:40821/ using document root <none> and password file <none>
I20260807 00:38:22.957998 25010 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:22.958061 25010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:22.959609 25010 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:22.960345 25029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:22.960567 25010 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:22.960678 25010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "ffc1b45415d04290be8a6fb7d8810ac7"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "2008cd2720d16c356bc1ef702c91cb0b"
server_key_iv: "91ac4ced41eddba441331cdc4722736b"
server_key_version: "encryptionkey@0"
I20260807 00:38:22.961071 25010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:22.968732 25010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:22.971088 25010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:22.971261 25010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:22.971513 25010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:22.971850 25010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:22.971905 25010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:22.971956 25010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:22.971987 25010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:22.978466 25010 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:37697
I20260807 00:38:22.978569 25151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:37697 every 8 connection(s)
I20260807 00:38:22.978965 25010 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:38:22.979316 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25010
I20260807 00:38:22.979666 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:40621
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:35913
--webserver_port=45887
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 00:38:22 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063102, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:22.991746 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:22.980289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:38321 (local address 127.7.252.62:35913)
0807 00:38:22.980372 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:22.980374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:22.980386 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:38:22.980944 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:22.980945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:22.980958 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:22.981027 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:22.982409 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.983231 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.984397 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.984772 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.984861 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:22.987670 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:22.987672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:22.987673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:22.987683 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:22.989692 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:22.990230 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:22.990232 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:22.990232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:22.990303 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:22.990632 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:22.990633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:22.990634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:22.990825 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:22.990911 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:22.991490 (+ 579us) server_negotiation.cc:299] Negotiation successful
0807 00:38:22.991607 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 00:38:22.991968 25154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:22.979952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:38321)
0807 00:38:22.980141 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:22.980191 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:22.980826 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:22.981104 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:22.981108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:22.981946 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:22.982196 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:22.982201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.983360 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.983361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:22.984300 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:22.984303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:22.984941 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:22.984942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:22.985065 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:22.985717 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:22.985727 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:22.987555 (+ 1828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:22.989820 (+ 2265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:22.989829 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:22.989832 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:22.990126 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:22.990409 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:22.990410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:22.990410 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:22.990549 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:22.990939 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:22.990947 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:22.991172 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 00:38:22.991467 (+ 295us) client_negotiation.cc:240] Negotiation successful
0807 00:38:22.991637 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260807 00:38:22.992591 25152 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35913
I20260807 00:38:22.992722 25152 heartbeater.cc:464] Registering TS with master...
I20260807 00:38:22.993005 25152 heartbeater.cc:511] Master 127.7.252.62:35913 requested a full tablet report, sending...
I20260807 00:38:22.993579 24807 ts_manager.cc:194] Registered new tserver with Master: ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
I20260807 00:38:22.994135 24807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:38321
W20260807 00:38:23.072999 25155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:23.073275 25155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:23.073304 25155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:23.074591 25155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:23.074635 25155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:23.074693 25155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:38:23.076444 25155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:40621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=45887
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:23.076669 25155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:23.076879 25155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:38:23.082866 25155 server_base.cc:1034] running on GCE node
W20260807 00:38:23.082810 25163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:23.082828 25161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:23.082837 25160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:23.083264 25155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:23.083590 25155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:23.084780 25155 hybrid_clock.cc:648] HybridClock initialized: now 1786063103084759 us; error 40 us; skew 500 ppm
Aug 07 00:38:23 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063103, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:23.087728 25155 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:38:23.088244 25155 webserver.cc:460] Webserver started at http://127.7.252.3:45887/ using document root <none> and password file <none>
I20260807 00:38:23.088515 25155 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:23.088605 25155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:23.090097 25155 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:38:23.090967 25171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:23.091149 25155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:23.091245 25155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "bc2df90fd85c46289c42f32a3a505d82"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "ed7d5b12cfed2b0ae52239c67abf3f35"
server_key_iv: "50a619ec61107840cf6f9f045cc9f6cd"
server_key_version: "encryptionkey@0"
I20260807 00:38:23.091616 25155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:23.098881 25155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:23.101536 25155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:23.101675 25155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:23.101964 25155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:23.102334 25155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:23.102397 25155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:23.102445 25155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:23.102476 25155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:23.109164 25155 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40621
I20260807 00:38:23.109368 25289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40621 every 8 connection(s)
I20260807 00:38:23.109714 25155 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:38:23 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063103, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:38:23.116700 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25155
I20260807 00:38:23.120908 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.110713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:56221 (local address 127.7.252.62:35913)
0807 00:38:23.110790 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.110792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.111029 (+ 237us) server_negotiation.cc:407] Connection header received
0807 00:38:23.111659 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.111660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.111673 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.111798 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:23.112815 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.113330 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.114363 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.114573 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.114680 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.117375 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:23.117376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:23.117377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:23.117386 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:23.119208 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:23.119783 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:23.119784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:23.119784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:23.119844 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:23.120110 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:23.120112 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:23.120112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:23.120248 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:23.120327 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.120665 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.120809 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:38:23.121069 25292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.110695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:56221)
0807 00:38:23.110902 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:23.110940 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:23.111529 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:23.111881 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:23.111886 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:23.112508 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:23.112709 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.112714 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.113432 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.113433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.114264 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.114266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.114690 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.114691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.114823 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.115379 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:23.115388 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:23.117242 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:23.119364 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:23.119372 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:23.119375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:23.119682 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:23.119917 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:23.119917 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:23.119918 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:23.120028 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:23.120329 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:23.120336 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:23.120502 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 00:38:23.120627 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 00:38:23.120808 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260807 00:38:23.121536 25290 heartbeater.cc:347] Connected to a master server at 127.7.252.62:35913
I20260807 00:38:23.121654 25290 heartbeater.cc:464] Registering TS with master...
I20260807 00:38:23.121846 25290 heartbeater.cc:511] Master 127.7.252.62:35913 requested a full tablet report, sending...
I20260807 00:38:23.122282 24807 ts_manager.cc:194] Registered new tserver with Master: bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621)
I20260807 00:38:23.122700 24807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:56221
I20260807 00:38:23.124845 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.117344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.7.252.62:35913)
0807 00:38:23.117509 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.117511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.117518 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:38:23.117547 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.117548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.117559 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.117642 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:23.118242 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.118801 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.119914 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.120151 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.120241 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.121869 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:23.121871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:23.121871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:23.121879 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:23.123516 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:23.123958 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:23.123959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:23.123960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:23.124027 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:23.124251 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:23.124252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:23.124253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:23.124380 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:23.124577 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.124621 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.124713 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260807 00:38:23.125612 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:38:23.128799 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.126004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55512 (local address 127.7.252.62:35913)
0807 00:38:23.126044 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.126046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.126241 (+ 195us) server_negotiation.cc:407] Connection header received
0807 00:38:23.126280 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.126280 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.126311 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.126389 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:38:23.126587 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.127203 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.128010 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.128229 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.128297 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.128526 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:38:23.128575 (+ 49us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 00:38:23.128733 (+ 158us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55512: token expired
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 00:38:23.128906 25294 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55512: token expired
W20260807 00:38:23.129122 24735 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.252.62:35913)
I20260807 00:38:23.136610 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.129451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55524 (local address 127.7.252.62:35913)
0807 00:38:23.129490 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.129492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.129501 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:38:23.129546 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.129547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.129556 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.129603 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:23.130078 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.130789 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.131592 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.131811 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.131873 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.133163 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:23.133164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:23.133164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:23.133172 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:23.135105 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:23.135561 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:23.135562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:23.135562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:23.135622 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:23.135878 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:23.135879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:23.135879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:23.136036 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:23.136120 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.136442 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.136534 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:38:23.138263 24807 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55524:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:38:23.140210 24807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:38:23.142814 24932 tablet_service.cc:1467] Processing CreateTablet for tablet 878b58979a4848cbb05da95853e4a8bf (DEFAULT_TABLE table=test-table [id=f668a45a89344965883faa8dbf90ab36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:38:23.143052 24932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 878b58979a4848cbb05da95853e4a8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:23.144799 24890 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Bootstrap starting.
I20260807 00:38:23.145182 24890 tablet_bootstrap.cc:654] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:23.145769 24890 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: No bootstrap required, opened a new log
I20260807 00:38:23.145824 24890 ts_tablet_manager.cc:1397] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 00:38:23.145942 24890 raft_consensus.cc:348] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.146010 24890 raft_consensus.cc:374] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:23.146056 24890 raft_consensus.cc:729] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad5957b50340bf9c54823abf00b366, State: Initialized, Role: FOLLOWER
I20260807 00:38:23.146102 24890 consensus_queue.cc:260] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.146186 24890 ts_tablet_manager.cc:1428] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:23.147055 25296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.142508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:37697 (local address 127.0.0.1:41124)
0807 00:38:23.142722 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:23.142736 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:23.142837 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:23.143223 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:23.143224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:23.143226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:23.143279 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.143281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.144724 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.144725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.145778 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.145781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.146795 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.146796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.146863 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.146868 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:38:23.146922 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 00:38:23.146968 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":179,"threads_started":1}
I20260807 00:38:23.147179 25297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.142572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44400 (local address 127.7.252.3:40621)
0807 00:38:23.142819 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.142824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.142836 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:38:23.142878 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.142880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.142899 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.143152 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:23.143255 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.144422 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.145867 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.146786 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.146913 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.146982 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.147030 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.147064 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":130,"threads_started":1}
I20260807 00:38:23.147249 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.142850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41124 (local address 127.7.252.2:37697)
0807 00:38:23.143059 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.143064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.143074 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:38:23.143116 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.143118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.143136 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.143225 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:23.143377 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.144613 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.145892 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.146638 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.146772 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.146841 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.147104 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.147153 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":100,"threads_started":1}
I20260807 00:38:23.147197 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.142388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40621 (local address 127.0.0.1:44400)
0807 00:38:23.142429 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:23.142442 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:23.142487 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:23.143013 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:23.143014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:23.143016 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:23.143073 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.143075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.144523 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.144525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.145775 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.145779 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.146914 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.146915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.146966 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.146968 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 00:38:23.147010 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 00:38:23.147045 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260807 00:38:23.148142 25221 tablet_service.cc:1467] Processing CreateTablet for tablet 878b58979a4848cbb05da95853e4a8bf (DEFAULT_TABLE table=test-table [id=f668a45a89344965883faa8dbf90ab36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:38:23.148145 25082 tablet_service.cc:1467] Processing CreateTablet for tablet 878b58979a4848cbb05da95853e4a8bf (DEFAULT_TABLE table=test-table [id=f668a45a89344965883faa8dbf90ab36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:38:23.148552 25082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 878b58979a4848cbb05da95853e4a8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:23.148553 25221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 878b58979a4848cbb05da95853e4a8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:38:23.151598 25301 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Bootstrap starting.
I20260807 00:38:23.152077 25302 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Bootstrap starting.
I20260807 00:38:23.152433 25301 tablet_bootstrap.cc:654] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:23.152876 25302 tablet_bootstrap.cc:654] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Neither blocks nor log segments found. Creating new log.
I20260807 00:38:23.153057 25301 log.cc:824] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:23.153417 25302 log.cc:824] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:23.153986 25301 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: No bootstrap required, opened a new log
I20260807 00:38:23.154090 25301 ts_tablet_manager.cc:1397] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:38:23.154451 25302 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: No bootstrap required, opened a new log
I20260807 00:38:23.154522 25302 ts_tablet_manager.cc:1397] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:38:23.155915 25301 raft_consensus.cc:348] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.155943 25302 raft_consensus.cc:348] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.156106 25302 raft_consensus.cc:374] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:23.156111 25301 raft_consensus.cc:374] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:38:23.156128 25302 raft_consensus.cc:729] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc2df90fd85c46289c42f32a3a505d82, State: Initialized, Role: FOLLOWER
I20260807 00:38:23.156169 25301 raft_consensus.cc:729] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc1b45415d04290be8a6fb7d8810ac7, State: Initialized, Role: FOLLOWER
I20260807 00:38:23.156307 25301 consensus_queue.cc:260] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.156306 25302 consensus_queue.cc:260] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.156647 25302 ts_tablet_manager.cc:1428] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 00:38:23.156699 25301 ts_tablet_manager.cc:1428] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 00:38:23.156736 25290 heartbeater.cc:503] Master 127.7.252.62:35913 was elected leader, sending a full tablet report...
I20260807 00:38:23.156840 25152 heartbeater.cc:503] Master 127.7.252.62:35913 was elected leader, sending a full tablet report...
I20260807 00:38:23.196909 25306 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:23.197091 25306 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.197568 25306 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339)
I20260807 00:38:23.201897 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.197866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:40415 (local address 127.7.252.1:42339)
0807 00:38:23.197920 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.197922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.197936 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:38:23.197974 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.197975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.197988 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.198075 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:23.198324 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.199124 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.200747 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.201449 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.201521 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.201530 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.201771 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.201825 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:38:23.201897 25297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.197886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:38403 (local address 127.7.252.3:40621)
0807 00:38:23.197934 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.197936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.198104 (+ 168us) server_negotiation.cc:407] Connection header received
0807 00:38:23.198240 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.198242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.198256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.198321 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:38:23.198520 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.199287 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.200766 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.201357 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.201441 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.201455 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.201767 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.201822 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:38:23.201889 25154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.197780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42339 (local address 127.7.252.2:40415)
0807 00:38:23.197847 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:23.197860 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:23.197910 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:23.198084 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:23.198086 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:23.198088 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:23.198174 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.198176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.199279 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.199280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.200636 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.200639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.201541 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.201542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.201622 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.201625 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:38:23.201696 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:38:23.201771 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":33}
I20260807 00:38:23.201898 25307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.197830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40621 (local address 127.7.252.2:38403)
0807 00:38:23.198021 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:23.198030 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:23.198129 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:23.198340 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:23.198341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:23.198343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:38:23.198444 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.198446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.199351 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.199352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.200636 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:23.200639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.201470 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.201471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:23.201595 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.201603 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 00:38:23.201696 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 00:38:23.201800 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":3,"thread_start_us":130,"threads_started":1}
I20260807 00:38:23.202359 25241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878b58979a4848cbb05da95853e4a8bf" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc2df90fd85c46289c42f32a3a505d82" is_pre_election: true
I20260807 00:38:23.202574 25241 raft_consensus.cc:2454] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 0.
I20260807 00:38:23.202718 24954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878b58979a4848cbb05da95853e4a8bf" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad5957b50340bf9c54823abf00b366" is_pre_election: true
I20260807 00:38:23.202876 25032 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7; no voters:
I20260807 00:38:23.202916 24954 raft_consensus.cc:2454] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 0.
I20260807 00:38:23.203027 25306 raft_consensus.cc:2781] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:38:23.203088 25306 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:38:23.203112 25306 raft_consensus.cc:3037] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:23.203850 25306 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.204000 25306 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 election: Requested vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339)
I20260807 00:38:23.204185 25241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878b58979a4848cbb05da95853e4a8bf" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc2df90fd85c46289c42f32a3a505d82"
I20260807 00:38:23.204278 25241 raft_consensus.cc:3037] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:23.204227 24954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878b58979a4848cbb05da95853e4a8bf" candidate_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dad5957b50340bf9c54823abf00b366"
I20260807 00:38:23.204339 24954 raft_consensus.cc:3037] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:38:23.205394 24954 raft_consensus.cc:2454] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 1.
I20260807 00:38:23.205415 25241 raft_consensus.cc:2454] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc1b45415d04290be8a6fb7d8810ac7 in term 1.
I20260807 00:38:23.205590 25033 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dad5957b50340bf9c54823abf00b366, ffc1b45415d04290be8a6fb7d8810ac7; no voters:
I20260807 00:38:23.205710 25306 raft_consensus.cc:2781] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:38:23.205855 25306 raft_consensus.cc:686] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 LEADER]: Becoming Leader. State: Replica: ffc1b45415d04290be8a6fb7d8810ac7, State: Running, Role: LEADER
I20260807 00:38:23.205960 25306 consensus_queue.cc:237] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:23.207051 24805 catalog_manager.cc:5495] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2). New cstate: current_term: 1 leader_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20260807 00:38:23.225476 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:23.222600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41130 (local address 127.7.252.2:37697)
0807 00:38:23.222736 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:23.222739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:23.222748 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:38:23.222792 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:23.222793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:23.222824 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:23.222939 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:38:23.223096 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.223635 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.224500 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:23.224738 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:23.224835 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:23.225028 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:38:23.225169 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:38:23.225274 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:23.225301 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 00:38:23.225328 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:38:23.227619 25241 raft_consensus.cc:1261] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Refusing update from remote peer ffc1b45415d04290be8a6fb7d8810ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:38:23.227643 24954 raft_consensus.cc:1261] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Refusing update from remote peer ffc1b45415d04290be8a6fb7d8810ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:38:23.228078 25306 consensus_queue.cc:1035] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:38:23.228261 25308 consensus_queue.cc:1035] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 00:38:23.229625 25153 tablet.cc:2369] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:38:23.231295 25311 mvcc.cc:205] Tried to move back new op lower bound from 7315714470817419264 to 7315714470732492800. Current Snapshot: MvccSnapshot[applied={T|T < 7315714470817419264}]
I20260807 00:38:23.231343 25312 mvcc.cc:205] Tried to move back new op lower bound from 7315714470817419264 to 7315714470732492800. Current Snapshot: MvccSnapshot[applied={T|T < 7315714470817419264}]
I20260807 00:38:23.234040 24805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:38:23.234160 24805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:38:23.235057 24805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Sending DeleteTablet for 3 replicas of tablet 878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:23.235488 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 24847
I20260807 00:38:23.235463 25221 tablet_service.cc:1514] Processing DeleteTablet for tablet 878b58979a4848cbb05da95853e4a8bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:23 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:44400
I20260807 00:38:23.235529 24932 tablet_service.cc:1514] Processing DeleteTablet for tablet 878b58979a4848cbb05da95853e4a8bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:23 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:39626
I20260807 00:38:23.235630 25014 tablet_replica.cc:330] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: stopping tablet replica
I20260807 00:38:23.235680 25014 raft_consensus.cc:2229] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:38:23.235751 25014 raft_consensus.cc:2258] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:38:23.236146 25082 tablet_service.cc:1514] Processing DeleteTablet for tablet 878b58979a4848cbb05da95853e4a8bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:38:23 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:41124
I20260807 00:38:23.236423 25321 tablet_replica.cc:330] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: stopping tablet replica
I20260807 00:38:23.236620 25321 raft_consensus.cc:2229] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:38:23.236856 25321 raft_consensus.cc:2258] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:38:23.239384 25321 ts_tablet_manager.cc:1905] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:38:23.241899 25321 ts_tablet_manager.cc:1918] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:38:23.242003 25321 log.cc:1196] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:23.242347 25321 ts_tablet_manager.cc:1939] T 878b58979a4848cbb05da95853e4a8bf P ffc1b45415d04290be8a6fb7d8810ac7: Deleting consensus metadata
I20260807 00:38:23.242825 25320 tablet_replica.cc:330] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: stopping tablet replica
I20260807 00:38:23.242940 24793 catalog_manager.cc:4841] TS ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): tablet 878b58979a4848cbb05da95853e4a8bf (table test-table [id=f668a45a89344965883faa8dbf90ab36]) successfully deleted
I20260807 00:38:23.243103 25320 raft_consensus.cc:2229] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:38:23.243243 25320 raft_consensus.cc:2258] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:38:23.243777 25320 ts_tablet_manager.cc:1905] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 00:38:23.244711 24792 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:42339 (error 108)
W20260807 00:38:23.245518 25296 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:38:23.245199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42339 (local address 127.0.0.1:39632)
0807 00:38:23.245265 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:23.245281 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:23.245331 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:23.245464 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42339: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 00:38:23.245682 25320 ts_tablet_manager.cc:1918] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:38:23.245762 25320 log.cc:1196] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:23.246057 25320 ts_tablet_manager.cc:1939] T 878b58979a4848cbb05da95853e4a8bf P bc2df90fd85c46289c42f32a3a505d82: Deleting consensus metadata
W20260807 00:38:23.245679 24792 catalog_manager.cc:4584] TS 0dad5957b50340bf9c54823abf00b366 (127.7.252.1:42339): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 878b58979a4848cbb05da95853e4a8bf: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42339: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 00:38:23.246486 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 25010
I20260807 00:38:23.246513 24791 catalog_manager.cc:4841] TS bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): tablet 878b58979a4848cbb05da95853e4a8bf (table test-table [id=f668a45a89344965883faa8dbf90ab36]) successfully deleted
I20260807 00:38:23.253155 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 25155
I20260807 00:38:23.258628 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 24773
I20260807 00:38:43.266891 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35913
--webserver_interface=127.7.252.62
--webserver_port=46323
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:35913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:43.356374 25323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:43.356652 25323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:43.356693 25323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:43.357966 25323 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 00:38:43.358050 25323 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 00:38:43.358073 25323 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 00:38:43.358093 25323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:38:43.358124 25323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:43.358150 25323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:43.358179 25323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:38:43.358206 25323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:38:43.359827 25323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:35913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:35913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=46323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:43.360142 25323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:43.360495 25323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:43.366103 25328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.366097 25329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:43.366147 25323 server_base.cc:1034] running on GCE node
W20260807 00:38:43.366097 25331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:43.366722 25323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:43.367053 25323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:43.368228 25323 hybrid_clock.cc:648] HybridClock initialized: now 1786063123368203 us; error 47 us; skew 500 ppm
Aug 07 00:38:43 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063123, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:43.375458 25323 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:38:43.376005 25323 webserver.cc:460] Webserver started at http://127.7.252.62:46323/ using document root <none> and password file <none>
I20260807 00:38:43.376327 25323 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:43.376413 25323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:43.377993 25323 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 00:38:43.378963 25338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.379177 25323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:43.379377 25323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "63cd790d7e0242cfb2903b6b0a623109"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "b174cccc2ae2c77a6a774f9c41c2105a"
server_key_iv: "cbdc81f88807619269e42b6585ea247e"
server_key_version: "encryptionkey@0"
I20260807 00:38:43.379788 25323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:43.397243 25323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:43.400127 25323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:43.400424 25323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:43.405587 25323 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:35913
I20260807 00:38:43.405683 25394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:35913 every 8 connection(s)
I20260807 00:38:43.406117 25323 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:38:43.407806 25395 sys_catalog.cc:263] Verifying existing consensus state
I20260807 00:38:43.408538 25395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap starting.
I20260807 00:38:43.414541 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25323
I20260807 00:38:43.414979 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:42339
--local_ip_for_outbound_sockets=127.7.252.1
--tserver_master_addrs=127.7.252.62:35913
--webserver_port=33145
--webserver_interface=127.7.252.1
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:38:43.419094 25395 log.cc:824] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:43.421597 25395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:38:43.422008 25395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Bootstrap complete.
I20260807 00:38:43.424526 25395 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:43.424799 25395 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cd790d7e0242cfb2903b6b0a623109, State: Initialized, Role: FOLLOWER
I20260807 00:38:43.425021 25395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:43.425124 25395 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:38:43.425199 25395 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:38:43.425248 25395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 2 FOLLOWER]: Advancing to term 3
I20260807 00:38:43.426332 25395 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:43.426470 25395 leader_election.cc:302] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63cd790d7e0242cfb2903b6b0a623109; no voters:
I20260807 00:38:43.426725 25395 leader_election.cc:288] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 00:38:43.426769 25399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 00:38:43.426899 25399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [term 3 LEADER]: Becoming Leader. State: Replica: 63cd790d7e0242cfb2903b6b0a623109, State: Running, Role: LEADER
I20260807 00:38:43.426990 25399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } }
I20260807 00:38:43.427026 25395 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:38:43.427287 25399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63cd790d7e0242cfb2903b6b0a623109. Latest consensus state: current_term: 3 leader_uuid: "63cd790d7e0242cfb2903b6b0a623109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } } }
I20260807 00:38:43.427361 25399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: This master's current role is: LEADER
I20260807 00:38:43.427639 25400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "63cd790d7e0242cfb2903b6b0a623109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cd790d7e0242cfb2903b6b0a623109" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 35913 } } }
I20260807 00:38:43.427726 25400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109 [sys.catalog]: This master's current role is: LEADER
I20260807 00:38:43.427819 25403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:38:43.428735 25403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:38:43.428877 25403 catalog_manager.cc:1259] Loaded cluster ID: 16163cfed85f4814874002c93cee07e6
I20260807 00:38:43.429155 25403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:38:43.430608 25403 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:38:43.430856 25403 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Loaded TSK: 0
I20260807 00:38:43.430912 25403 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 63cd790d7e0242cfb2903b6b0a623109: Loaded TSK: 1
F20260807 00:38:43.431196 25403 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f51263929ad google::LogMessage::Fail() at ??:0
@ 0x7f512639588a google::LogMessage::SendToLog() at ??:0
@ 0x7f51263924de google::LogMessage::Flush() at ??:0
@ 0x7f5126393a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5128aff104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5128afcd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f512e2ec1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f512e2ec48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f512e2ec594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f512e2b2c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f512e2bcad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f51282600d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5128255954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f51290b96db start_thread at ??:0
@ 0x7f5124e9061f clone at ??:0
W20260807 00:38:43.526546 25397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:43.526865 25397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:43.526932 25397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:43.528206 25397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:43.528288 25397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:43.528344 25397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:38:43.529948 25397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:42339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=33145
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:43.530247 25397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:43.530514 25397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:43.536316 25440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.536319 25438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.536316 25437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:43.537324 25397 server_base.cc:1034] running on GCE node
I20260807 00:38:43.537632 25397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:43.538012 25397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:43.539426 25397 hybrid_clock.cc:648] HybridClock initialized: now 1786063123539390 us; error 58 us; skew 500 ppm
Aug 07 00:38:43 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063123, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:43.542941 25397 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:38:43.543569 25397 webserver.cc:460] Webserver started at http://127.7.252.1:33145/ using document root <none> and password file <none>
I20260807 00:38:43.543874 25397 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:43.543960 25397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:43.545691 25397 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:38:43.546643 25448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.546885 25397 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:43.546999 25397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "0dad5957b50340bf9c54823abf00b366"
format_stamp: "Formatted at 2026-08-07 00:38:01 on dist-test-slave-csg5"
server_key: "15f3384d645a2f0fed22484040f8966a"
server_key_iv: "c0e7d0728e64c9b07de06bf545061856"
server_key_version: "encryptionkey@0"
I20260807 00:38:43.547441 25397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:43.558398 25397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:43.561271 25397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:43.561478 25397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:43.561765 25397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:43.562305 25455 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 00:38:43.564471 25397 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 00:38:43.564574 25397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 00:38:43.564635 25397 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 00:38:43.565464 25397 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 00:38:43.565531 25397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 00:38:43.565605 25455 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Bootstrap starting.
I20260807 00:38:43.573936 25397 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42339
I20260807 00:38:43.574128 25565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42339 every 8 connection(s)
I20260807 00:38:43.574462 25397 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:38:43.577529 25455 log.cc:824] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Log is configured to *not* fsync() on all Append() calls
I20260807 00:38:43.580703 25455 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 00:38:43.581168 25455 tablet_bootstrap.cc:492] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Bootstrap complete.
I20260807 00:38:43.582396 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25397
I20260807 00:38:43.582476 25455 ts_tablet_manager.cc:1397] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20260807 00:38:43.582814 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:37697
--local_ip_for_outbound_sockets=127.7.252.2
--tserver_master_addrs=127.7.252.62:35913
--webserver_port=40821
--webserver_interface=127.7.252.2
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:38:43.584034 25455 raft_consensus.cc:348] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:43.584419 25455 raft_consensus.cc:729] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dad5957b50340bf9c54823abf00b366, State: Initialized, Role: FOLLOWER
I20260807 00:38:43.584618 25455 consensus_queue.cc:260] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:43.584964 25455 ts_tablet_manager.cc:1428] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
W20260807 00:38:43.664743 25568 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:38:43.575306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:37083)
0807 00:38:43.575509 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.575560 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:43.576090 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:43.664508 (+ 88418us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
W20260807 00:38:43.665071 25566 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:35913 (0 consecutive failures): Network error: Failed to ping master at 127.7.252.62:35913: Client connection negotiation failed: client connection to 127.7.252.62:35913: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 00:38:43.665489 25568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.665333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:35881)
0807 00:38:43.665398 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.665451 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 00:38:43.665975 25568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.665853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:47099)
0807 00:38:43.665923 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.665954 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 00:38:43.666158 25566 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 00:38:43.680335 25570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:43.680634 25570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:43.680683 25570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:43.682106 25570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:43.682195 25570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:43.682263 25570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:38:43.684098 25570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:37697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=40821
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:43.684437 25570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:43.684710 25570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:43.690459 25579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.690587 25577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.690587 25576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:43.690770 25570 server_base.cc:1034] running on GCE node
I20260807 00:38:43.690994 25570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:43.691234 25570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:43.692441 25570 hybrid_clock.cc:648] HybridClock initialized: now 1786063123692428 us; error 31 us; skew 500 ppm
Aug 07 00:38:43 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063123, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:43.695559 25570 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:38:43.696152 25570 webserver.cc:460] Webserver started at http://127.7.252.2:40821/ using document root <none> and password file <none>
I20260807 00:38:43.696506 25570 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:43.696597 25570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:43.698361 25570 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:43.699205 25586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.699505 25570 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:38:43.699643 25570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "ffc1b45415d04290be8a6fb7d8810ac7"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "2008cd2720d16c356bc1ef702c91cb0b"
server_key_iv: "91ac4ced41eddba441331cdc4722736b"
server_key_version: "encryptionkey@0"
I20260807 00:38:43.700244 25570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:43.713923 25570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:43.716532 25570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:43.716727 25570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:43.716992 25570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:43.717358 25570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:43.717422 25570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.717468 25570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:43.717494 25570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.724644 25570 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:37697
I20260807 00:38:43.724704 25707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:37697 every 8 connection(s)
I20260807 00:38:43.725114 25570 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:38:43.726629 25710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.725888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:43963)
0807 00:38:43.726087 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.726176 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
W20260807 00:38:43.727027 25708 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:35913 (0 consecutive failures): Network error: Failed to ping master at 127.7.252.62:35913: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
I20260807 00:38:43.727417 25710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.727276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:35951)
0807 00:38:43.727351 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.727395 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 00:38:43.727713 25710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.727658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:56665)
0807 00:38:43.727680 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.727700 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260807 00:38:43.727891 25708 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 00:38:43.730106 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25570
I20260807 00:38:43.730398 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:40621
--local_ip_for_outbound_sockets=127.7.252.3
--tserver_master_addrs=127.7.252.62:35913
--webserver_port=45887
--webserver_interface=127.7.252.3
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:38:43.818239 25712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:38:43.818480 25712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:38:43.818507 25712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:38:43.819775 25712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:38:43.819833 25712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:38:43.819862 25712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:38:43.821372 25712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:40621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=45887
--tserver_master_addrs=127.7.252.62:35913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:38:43.821604 25712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:38:43.821794 25712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:38:43.827518 25720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.827508 25717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:38:43.827508 25718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:38:43.827857 25712 server_base.cc:1034] running on GCE node
I20260807 00:38:43.828023 25712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:38:43.828227 25712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:38:43.829391 25712 hybrid_clock.cc:648] HybridClock initialized: now 1786063123829373 us; error 28 us; skew 500 ppm
Aug 07 00:38:43 dist-test-slave-csg5 krb5kdc[24195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063123, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:38:43.832280 25712 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:38:43.832751 25712 webserver.cc:460] Webserver started at http://127.7.252.3:45887/ using document root <none> and password file <none>
I20260807 00:38:43.832955 25712 fs_manager.cc:359] Metadata directory not provided
I20260807 00:38:43.832998 25712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:38:43.834388 25712 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:38:43.835088 25727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.835398 25712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:38:43.835506 25712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "bc2df90fd85c46289c42f32a3a505d82"
format_stamp: "Formatted at 2026-08-07 00:38:02 on dist-test-slave-csg5"
server_key: "ed7d5b12cfed2b0ae52239c67abf3f35"
server_key_iv: "50a619ec61107840cf6f9f045cc9f6cd"
server_key_version: "encryptionkey@0"
I20260807 00:38:43.835894 25712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:38:43.851789 25712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:38:43.854413 25712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:38:43.854600 25712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:38:43.854918 25712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:38:43.855268 25712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:38:43.855332 25712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.855376 25712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:38:43.855404 25712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:38:43.862146 25712 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40621
I20260807 00:38:43.862238 25846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40621 every 8 connection(s)
I20260807 00:38:43.862604 25712 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:38:43.863963 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.863516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:57063)
0807 00:38:43.863742 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.863819 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
W20260807 00:38:43.864447 25847 heartbeater.cc:644] Failed to heartbeat to 127.7.252.62:35913 (0 consecutive failures): Network error: Failed to ping master at 127.7.252.62:35913: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
I20260807 00:38:43.864871 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.864727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:42307)
0807 00:38:43.864811 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.864845 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 00:38:43.865317 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:43.865223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:38137)
0807 00:38:43.865267 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:43.865296 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 00:38:43.865504 25847 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 00:38:43.867223 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25712
I20260807 00:38:44.667145 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:44.666820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:44505)
0807 00:38:44.667009 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:44.667061 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":75,"threads_started":1}
I20260807 00:38:44.728600 25852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:44.728331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:52705)
0807 00:38:44.728485 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:44.728535 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
I20260807 00:38:44.866322 25853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:44.865964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:39721)
0807 00:38:44.866131 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:44.866252 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":70,"threads_started":1}
I20260807 00:38:45.114694 25854 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:45.114848 25854 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:45.115147 25854 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
Aug 07 00:38:45 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063123, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.2@KRBTEST.COM
Aug 07 00:38:45 dist-test-slave-csg5 krb5kdc[24195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063123, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.3@KRBTEST.COM
I20260807 00:38:45.129731 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.115460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:37697 (local address 127.7.252.1:47667)
0807 00:38:45.115591 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:45.115604 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:45.115666 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:45.116777 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:45.116780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:45.117345 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:45.117632 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:45.117640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.119499 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.119500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:45.120805 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:45.120808 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.121718 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.121719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:45.121929 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:45.122759 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:45.122771 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:45.124868 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:45.127290 (+ 2422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:45.127300 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:45.127304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:45.127712 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:45.128083 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:45.128084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:45.128085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:45.128261 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:45.129093 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:45.129101 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:45.129272 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 00:38:45.129391 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 00:38:45.129613 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":91}
I20260807 00:38:45.129868 25857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.115592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:47667 (local address 127.7.252.2:37697)
0807 00:38:45.115772 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:45.115785 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:45.115821 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:38:45.116431 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:45.116434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:45.116494 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:45.116662 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:45.117798 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.119397 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.120933 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.121593 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.121716 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:45.125028 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:45.125035 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:45.125035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:45.125054 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:45.127186 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:45.127829 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:45.127833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:45.127834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:45.127972 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:45.128588 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:45.128590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:45.128590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:45.128996 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:45.129074 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:45.129528 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 00:38:45.129723 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":80,"threads_started":1}
I20260807 00:38:45.130120 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.115592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:60223 (local address 127.7.252.3:40621)
0807 00:38:45.115772 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 00:38:45.115785 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 00:38:45.115821 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:38:45.116431 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:38:45.116435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:38:45.116494 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:38:45.116662 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:38:45.117829 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.119264 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.120933 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.121593 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.121716 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:45.125478 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:38:45.125483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:38:45.125483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:38:45.125494 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:38:45.127492 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:45.128098 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:45.128103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:45.128103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:45.128255 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:38:45.128825 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:38:45.128826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:38:45.128827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:38:45.129164 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:38:45.129262 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 00:38:45.129617 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 00:38:45.129760 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":60,"threads_started":1}
I20260807 00:38:45.129921 25855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.115475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40621 (local address 127.7.252.1:60223)
0807 00:38:45.115710 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:45.115734 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 00:38:45.115776 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:38:45.116777 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:38:45.116780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:38:45.117345 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:38:45.117632 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:45.117640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.119396 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.119397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:45.120805 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:38:45.120813 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:38:45.121720 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:38:45.121721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:38:45.121929 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:38:45.122789 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:38:45.122793 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:38:45.125341 (+ 2548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:38:45.127646 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:45.127647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:45.127647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:45.127925 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:45.128589 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:38:45.128591 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:38:45.128591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:38:45.128698 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:38:45.129295 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:38:45.129297 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:38:45.129355 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 00:38:45.129501 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 00:38:45.129725 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":143,"thread_start_us":69,"threads_started":1}
W20260807 00:38:45.130852 25452 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
W20260807 00:38:45.131244 25450 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:45.131330 25450 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad5957b50340bf9c54823abf00b366; no voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7
I20260807 00:38:45.131488 25854 raft_consensus.cc:2726] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:38:45.668105 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.667835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:37913)
0807 00:38:45.668003 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:45.668054 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":76,"threads_started":1}
I20260807 00:38:45.729697 25859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.729411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:43377)
0807 00:38:45.729592 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:45.729640 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":86,"threads_started":1}
I20260807 00:38:45.867261 25860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:45.866956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:32769)
0807 00:38:45.867147 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:45.867200 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":71,"threads_started":1}
I20260807 00:38:46.669055 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:46.668766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:40025)
0807 00:38:46.668951 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:46.669002 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":87,"threads_started":1}
I20260807 00:38:46.730631 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:46.730358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:36491)
0807 00:38:46.730516 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:46.730580 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260807 00:38:46.868010 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:46.867756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:43431)
0807 00:38:46.867921 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:46.867961 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":71,"threads_started":1}
I20260807 00:38:47.356539 25864 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:47.356690 25864 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:47.356882 25864 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
W20260807 00:38:47.357486 25450 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
W20260807 00:38:47.357671 25452 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:47.357741 25452 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad5957b50340bf9c54823abf00b366; no voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7
I20260807 00:38:47.357884 25864 raft_consensus.cc:2726] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:38:47.670063 25865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:47.669741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:46483)
0807 00:38:47.669960 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:47.670010 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":95,"threads_started":1}
I20260807 00:38:47.731446 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:47.731168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:56895)
0807 00:38:47.731327 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:47.731378 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":67,"threads_started":1}
I20260807 00:38:47.868894 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:47.868600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:49079)
0807 00:38:47.868763 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:47.868815 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260807 00:38:48.671168 25868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:48.670926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:47593)
0807 00:38:48.671077 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:48.671116 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260807 00:38:48.732379 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:48.732099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:40575)
0807 00:38:48.732281 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:48.732329 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":72,"threads_started":1}
I20260807 00:38:48.870010 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:48.869712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:39145)
0807 00:38:48.869908 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:48.869959 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":90,"threads_started":1}
I20260807 00:38:49.614208 25871 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:49.614308 25871 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:49.614498 25871 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
W20260807 00:38:49.614966 25452 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
W20260807 00:38:49.615156 25450 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:49.615222 25450 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad5957b50340bf9c54823abf00b366; no voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7
I20260807 00:38:49.615291 25871 raft_consensus.cc:2726] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:38:49.672164 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:49.671870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:44039)
0807 00:38:49.672054 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:49.672107 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260807 00:38:49.733273 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:49.732985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:40205)
0807 00:38:49.733144 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:49.733199 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260807 00:38:49.870810 25874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:49.870504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:41581)
0807 00:38:49.870726 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:49.870760 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":91,"threads_started":1}
I20260807 00:38:50.673256 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:50.672912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:46179)
0807 00:38:50.673086 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:50.673132 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":72,"threads_started":1}
I20260807 00:38:50.734229 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:50.733929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:34707)
0807 00:38:50.734119 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:50.734171 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260807 00:38:50.871654 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:50.871389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:40447)
0807 00:38:50.871552 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:50.871601 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260807 00:38:51.674392 25878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:51.674004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:52417)
0807 00:38:51.674185 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:51.674334 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":82,"threads_started":1}
I20260807 00:38:51.735050 25879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:51.734808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:45317)
0807 00:38:51.734953 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:51.734995 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":74,"threads_started":1}
I20260807 00:38:51.872612 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:51.872328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:44517)
0807 00:38:51.872509 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:51.872559 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
I20260807 00:38:52.675698 25881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:52.675409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:49571)
0807 00:38:52.675593 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:52.675646 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":76,"threads_started":1}
I20260807 00:38:52.736052 25882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:52.735747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:46797)
0807 00:38:52.735935 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:52.735988 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
I20260807 00:38:52.873449 25883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:52.873191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:41993)
0807 00:38:52.873355 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:52.873399 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260807 00:38:52.994040 25884 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:52.994150 25884 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:52.994388 25884 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
W20260807 00:38:52.994836 25450 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
W20260807 00:38:52.994906 25452 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:52.994953 25450 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad5957b50340bf9c54823abf00b366; no voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7
I20260807 00:38:52.995033 25884 raft_consensus.cc:2726] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:38:53.676680 25885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:53.676406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:54473)
0807 00:38:53.676578 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:53.676624 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":80,"threads_started":1}
I20260807 00:38:53.737109 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:53.736805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:40447)
0807 00:38:53.737008 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:53.737057 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":89,"threads_started":1}
I20260807 00:38:53.874334 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:53.874030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:55727)
0807 00:38:53.874224 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:53.874280 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":67,"threads_started":1}
I20260807 00:38:54.677732 25888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:54.677429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:51615)
0807 00:38:54.677602 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:54.677664 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":71,"threads_started":1}
I20260807 00:38:54.738224 25889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:54.737920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:48675)
0807 00:38:54.738113 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:54.738157 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":102,"threads_started":1}
I20260807 00:38:54.875371 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:54.875019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:55113)
0807 00:38:54.875172 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:54.875311 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260807 00:38:55.678812 25891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:55.678485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:32865)
0807 00:38:55.678643 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:55.678753 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":73,"threads_started":1}
I20260807 00:38:55.739259 25892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:55.738972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:34777)
0807 00:38:55.739145 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:55.739197 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260807 00:38:55.876300 25893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:55.876058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:37181)
0807 00:38:55.876201 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:55.876247 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260807 00:38:56.401612 25894 raft_consensus.cc:482] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:38:56.401744 25894 raft_consensus.cc:504] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc2df90fd85c46289c42f32a3a505d82" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40621 } } peers { permanent_uuid: "ffc1b45415d04290be8a6fb7d8810ac7" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37697 } } peers { permanent_uuid: "0dad5957b50340bf9c54823abf00b366" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42339 } }
I20260807 00:38:56.401979 25894 leader_election.cc:288] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621), ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697)
W20260807 00:38:56.402417 25452 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc1b45415d04290be8a6fb7d8810ac7 (127.7.252.2:37697): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
W20260807 00:38:56.402499 25450 leader_election.cc:341] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bc2df90fd85c46289c42f32a3a505d82 (127.7.252.3:40621): Not found: Tablet not found: 878b58979a4848cbb05da95853e4a8bf
I20260807 00:38:56.402563 25450 leader_election.cc:302] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dad5957b50340bf9c54823abf00b366; no voters: bc2df90fd85c46289c42f32a3a505d82, ffc1b45415d04290be8a6fb7d8810ac7
I20260807 00:38:56.402689 25894 raft_consensus.cc:2726] T 878b58979a4848cbb05da95853e4a8bf P 0dad5957b50340bf9c54823abf00b366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 00:38:56.679720 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:56.679447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:53789)
0807 00:38:56.679624 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:56.679668 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260807 00:38:56.740168 25896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:56.739900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:40277)
0807 00:38:56.740071 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:56.740119 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
I20260807 00:38:56.877188 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:56.876927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:32975)
0807 00:38:56.877087 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:56.877136 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
I20260807 00:38:57.680744 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:57.680429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:39335)
0807 00:38:57.680643 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:57.680693 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":102,"threads_started":1}
I20260807 00:38:57.741257 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:57.740962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:35619)
0807 00:38:57.741152 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:57.741199 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":96,"threads_started":1}
I20260807 00:38:57.878118 25900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:57.877833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:40043)
0807 00:38:57.878019 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:57.878067 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":88,"threads_started":1}
I20260807 00:38:58.681825 25901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:58.681555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.1:44183)
0807 00:38:58.681721 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:58.681770 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260807 00:38:58.742221 25902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:58.741919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.2:40093)
0807 00:38:58.742110 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:58.742166 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":68,"threads_started":1}
I20260807 00:38:58.876235 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 25397
I20260807 00:38:58.879647 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:38:58.879370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:35913 (local address 127.7.252.3:56367)
0807 00:38:58.879534 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 00:38:58.879594 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.62:35913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260807 00:38:58.883332 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 25570
I20260807 00:38:58.890328 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 25712
2026-08-07T00:38:58Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58620 ms)
[----------] 30 tests from SecurityITest (248835 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:38:58 dist-test-slave-csg5 krb5kdc[25906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:38:58 dist-test-slave-csg5 krb5kdc[25906](info): set up 2 sockets
Aug 07 00:38:58 dist-test-slave-csg5 krb5kdc[25906](info): commencing operation
krb5kdc: starting...
W20260807 00:39:00.034351 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:00.181985 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:43197
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:43197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:00.269637 25919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:00.269928 25919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:00.269973 25919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:00.271297 25919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:00.271385 25919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:00.271410 25919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:00.271432 25919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:00.271466 25919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:00.273110 25919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:43197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:43197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:00.273458 25919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:00.273730 25919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:00.279500 25925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:00.279511 25924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:00.279522 25927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:00.280045 25919 server_base.cc:1034] running on GCE node
I20260807 00:39:00.280303 25919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:00.280619 25919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:00.281836 25919 hybrid_clock.cc:648] HybridClock initialized: now 1786063140281786 us; error 40 us; skew 500 ppm
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:00.285115 25919 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:00.285686 25919 webserver.cc:460] Webserver started at http://127.7.252.62:42771/ using document root <none> and password file <none>
I20260807 00:39:00.285941 25919 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:00.286015 25919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:00.286175 25919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:00.287410 25919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "384be37f6eb64df584985410a374640b"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "c1fde9de2d5eec8c8ca8a7f55243338f"
server_key_iv: "c607fb425bc580865c0f543496331c39"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.287869 25919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "384be37f6eb64df584985410a374640b"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "c1fde9de2d5eec8c8ca8a7f55243338f"
server_key_iv: "c607fb425bc580865c0f543496331c39"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.289549 25919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:00.290498 25937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.290899 25919 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:00.291010 25919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "384be37f6eb64df584985410a374640b"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "c1fde9de2d5eec8c8ca8a7f55243338f"
server_key_iv: "c607fb425bc580865c0f543496331c39"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.291101 25919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:00.319355 25919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:00.321754 25919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:00.321946 25919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:00.326614 25919 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:43197
I20260807 00:39:00.326815 25992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:43197 every 8 connection(s)
I20260807 00:39:00.327111 25919 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:00.328086 25993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:00.328593 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 25919
I20260807 00:39:00.328713 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:00.328948 8176 external_mini_cluster.cc:1428] Setting key ebd7c3f40774c6a6a6828ddf786919a5
I20260807 00:39:00.331753 25993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b: Bootstrap starting.
I20260807 00:39:00.332451 25993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:00.332794 25993 log.cc:824] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:00.333585 25993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b: No bootstrap required, opened a new log
I20260807 00:39:00.336148 25993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "384be37f6eb64df584985410a374640b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43197 } }
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:00.336372 25993 raft_consensus.cc:374] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:00.336417 25993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 384be37f6eb64df584985410a374640b, State: Initialized, Role: FOLLOWER
I20260807 00:39:00.336580 25993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "384be37f6eb64df584985410a374640b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43197 } }
I20260807 00:39:00.336686 25993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:00.336742 25993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:00.336803 25993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:00.337599 25993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "384be37f6eb64df584985410a374640b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43197 } }
I20260807 00:39:00.337744 25993 leader_election.cc:302] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 384be37f6eb64df584985410a374640b; no voters:
I20260807 00:39:00.337939 25993 leader_election.cc:288] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:00.338020 25998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:00.338202 25998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [term 1 LEADER]: Becoming Leader. State: Replica: 384be37f6eb64df584985410a374640b, State: Running, Role: LEADER
I20260807 00:39:00.338409 25998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "384be37f6eb64df584985410a374640b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43197 } }
I20260807 00:39:00.338271 25993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:00.339469 25999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "384be37f6eb64df584985410a374640b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "384be37f6eb64df584985410a374640b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43197 } } }
I20260807 00:39:00.339572 25999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:00.339838 26009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:00.340432 26009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:00.340562 26000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 384be37f6eb64df584985410a374640b. Latest consensus state: current_term: 1 leader_uuid: "384be37f6eb64df584985410a374640b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "384be37f6eb64df584985410a374640b" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43197 } } }
I20260807 00:39:00.340759 26000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:00.342044 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.329609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45196 (local address 127.7.252.62:43197)
0807 00:39:00.329852 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.329860 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.329888 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:39:00.330311 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.330318 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.330366 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.330487 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:00.331464 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.332484 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.333403 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.333875 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.334007 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.337073 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:00.337077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:00.337078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:00.337091 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:00.339704 (+ 2613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.340341 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.340345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.340346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.340486 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.340752 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.340753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.340754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.341160 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:00.341362 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.341589 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.341785 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":129,"threads_started":1}
I20260807 00:39:00.342833 26009 catalog_manager.cc:1347] Generated new cluster ID: 422f42690f484576bcb9d6f181752eff
I20260807 00:39:00.342887 26009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:00.361269 26009 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:00.361872 26009 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:00.369333 26009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b: Generated new TSK 0
I20260807 00:39:00.369560 26009 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:39:00.410921 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43197
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:00.518457 26019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:00.518714 26019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:00.518751 26019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:00.519884 26019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:00.519922 26019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:00.519949 26019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:39:00.521361 26019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:00.521560 26019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:00.521756 26019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:00.527282 26025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:00.527398 26027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:00.527549 26024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:00.527673 26019 server_base.cc:1034] running on GCE node
I20260807 00:39:00.527897 26019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:00.528221 26019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:00.529387 26019 hybrid_clock.cc:648] HybridClock initialized: now 1786063140529365 us; error 47 us; skew 500 ppm
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:00.539773 26019 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:39:00.540357 26019 webserver.cc:460] Webserver started at http://127.7.252.1:39749/ using document root <none> and password file <none>
I20260807 00:39:00.540639 26019 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:00.540691 26019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:00.540797 26019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:00.541961 26019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "5a55a48aca554d90b5118e613e0e65a1"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "c1cc6b312b9acc4dcae17d108d040bd8"
server_key_iv: "a601563e987b055896f390c63cf8bb13"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.542320 26019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "5a55a48aca554d90b5118e613e0e65a1"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "c1cc6b312b9acc4dcae17d108d040bd8"
server_key_iv: "a601563e987b055896f390c63cf8bb13"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.543881 26019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:00.544853 26035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.545080 26019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:00.545195 26019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "5a55a48aca554d90b5118e613e0e65a1"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "c1cc6b312b9acc4dcae17d108d040bd8"
server_key_iv: "a601563e987b055896f390c63cf8bb13"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.545320 26019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:00.571485 26019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:00.574141 26019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:00.574395 26019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:00.574649 26019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:00.575038 26019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:00.575074 26019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.575100 26019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:00.575115 26019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.581910 26019 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:33525
I20260807 00:39:00.581962 26157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:33525 every 8 connection(s)
I20260807 00:39:00.582341 26019 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:39:00.588577 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26019
I20260807 00:39:00.588688 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:39:00.588855 8176 external_mini_cluster.cc:1428] Setting key ebe6411b01b0e667e0cb573aa72e21f2
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:00.593726 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.583171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:44595 (local address 127.7.252.62:43197)
0807 00:39:00.583268 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.583271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.583472 (+ 201us) server_negotiation.cc:407] Connection header received
0807 00:39:00.584009 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.584011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.584028 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.584096 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:00.585189 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.585838 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.586949 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.587166 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.587235 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.589722 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:00.589724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:00.589724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:00.589749 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:00.591693 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.592449 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.592451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.592451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.592515 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.592873 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.592874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.592874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.593046 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:00.593124 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.593485 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.593590 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 00:39:00.593827 26160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.583116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43197 (local address 127.7.252.1:44595)
0807 00:39:00.583324 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:00.583365 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:00.583872 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:00.584191 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:00.584194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:00.584842 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:00.585060 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.585066 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.585968 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.585969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.586862 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.586865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.587324 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.587325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.587438 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.587998 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:00.588007 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:00.589556 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:00.591798 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:00.591810 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:00.591813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:00.592187 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:00.592603 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:00.592604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:00.592604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:00.592784 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:00.593122 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:00.593128 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:00.593327 (+ 199us) client_negotiation.cc:769] Sending connection context
0807 00:39:00.593430 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 00:39:00.593573 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":117,"threads_started":1}
I20260807 00:39:00.594502 26158 heartbeater.cc:347] Connected to a master server at 127.7.252.62:43197
I20260807 00:39:00.594619 26158 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:00.594897 26158 heartbeater.cc:511] Master 127.7.252.62:43197 requested a full tablet report, sending...
I20260807 00:39:00.595629 25955 ts_manager.cc:194] Registered new tserver with Master: 5a55a48aca554d90b5118e613e0e65a1 (127.7.252.1:33525)
I20260807 00:39:00.596701 25955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:44595
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:39:00.622833 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43197
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:00.711377 26163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:00.711650 26163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:00.711694 26163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:00.712925 26163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:00.713006 26163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:00.713055 26163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:39:00.714721 26163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:00.715050 26163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:00.715342 26163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:00.721312 26168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:00.721366 26163 server_base.cc:1034] running on GCE node
W20260807 00:39:00.721318 26171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:00.721587 26169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:00.721973 26163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:00.722364 26163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:00.723574 26163 hybrid_clock.cc:648] HybridClock initialized: now 1786063140723543 us; error 46 us; skew 500 ppm
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:00.727764 26163 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:39:00.728585 26163 webserver.cc:460] Webserver started at http://127.7.252.2:40051/ using document root <none> and password file <none>
I20260807 00:39:00.729321 26163 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:00.729430 26163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:00.729607 26163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:00.731283 26163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "59efbc943a21404a8880a60476e1a4df"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "34331c04ded77f4b7992dbac487c89b6"
server_key_iv: "965e03526c09bda8c1969350f99bc792"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.731840 26163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "59efbc943a21404a8880a60476e1a4df"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "34331c04ded77f4b7992dbac487c89b6"
server_key_iv: "965e03526c09bda8c1969350f99bc792"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.733513 26163 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:00.734535 26178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.734807 26163 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:00.734929 26163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "59efbc943a21404a8880a60476e1a4df"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "34331c04ded77f4b7992dbac487c89b6"
server_key_iv: "965e03526c09bda8c1969350f99bc792"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.735033 26163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:00.750916 26163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:00.753515 26163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:00.753729 26163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:00.754017 26163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:00.754381 26163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:00.754443 26163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.754523 26163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:00.754578 26163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.761266 26163 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:36859
I20260807 00:39:00.761395 26294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:36859 every 8 connection(s)
I20260807 00:39:00.761731 26163 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:00.770067 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26163
I20260807 00:39:00.770183 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:39:00.770481 8176 external_mini_cluster.cc:1428] Setting key 1e19362ef4fd556153b8f1866256a39c
I20260807 00:39:00.773059 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.762569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:45941 (local address 127.7.252.62:43197)
0807 00:39:00.762681 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.762684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.762927 (+ 243us) server_negotiation.cc:407] Connection header received
0807 00:39:00.763461 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.763462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.763473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.763533 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:00.764485 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.765030 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.766299 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.766500 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.766569 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.769509 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:00.769511 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:00.769511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:00.769519 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:00.771468 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.771997 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.771998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.771999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.772057 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.772380 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.772381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.772381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.772506 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:00.772566 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.772910 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.772986 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 00:39:00.773458 26298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.762541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43197 (local address 127.7.252.2:45941)
0807 00:39:00.762801 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:00.762839 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:00.763364 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:00.763590 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:00.763594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:00.764201 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:00.764396 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.764401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.765178 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.765179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.766167 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.766171 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.766613 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.766614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.766830 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.767634 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:00.767643 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:00.769396 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:00.771559 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:00.771569 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:00.771571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:00.771917 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:00.772136 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:00.772137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:00.772137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:00.772303 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:00.772576 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:00.772582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:00.772764 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 00:39:00.772886 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 00:39:00.773082 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":134,"threads_started":1}
I20260807 00:39:00.773952 26296 heartbeater.cc:347] Connected to a master server at 127.7.252.62:43197
I20260807 00:39:00.774085 26296 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:00.774336 26296 heartbeater.cc:511] Master 127.7.252.62:43197 requested a full tablet report, sending...
I20260807 00:39:00.774926 25955 ts_manager.cc:194] Registered new tserver with Master: 59efbc943a21404a8880a60476e1a4df (127.7.252.2:36859)
I20260807 00:39:00.775331 25955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:45941
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:39:00.807401 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43197
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:00.896255 26301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:00.896520 26301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:00.896549 26301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:00.897956 26301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:00.898015 26301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:00.898046 26301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:39:00.899878 26301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:00.900182 26301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:00.900487 26301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:00.906803 26309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:00.906832 26306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:00.906867 26301 server_base.cc:1034] running on GCE node
W20260807 00:39:00.906803 26307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:00.907433 26301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:00.907698 26301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:00.908872 26301 hybrid_clock.cc:648] HybridClock initialized: now 1786063140908840 us; error 43 us; skew 500 ppm
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:00.911878 26301 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:39:00.912341 26301 webserver.cc:460] Webserver started at http://127.7.252.3:40777/ using document root <none> and password file <none>
I20260807 00:39:00.912613 26301 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:00.912689 26301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:00.912871 26301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:00.914108 26301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "b10164f15c6946c38404c958ff933c31"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "2c395390101c2f2a4d5292aa6051e9e2"
server_key_iv: "ba15315e269fb9ecd1ec2b2ad1a350e7"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.914525 26301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "b10164f15c6946c38404c958ff933c31"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "2c395390101c2f2a4d5292aa6051e9e2"
server_key_iv: "ba15315e269fb9ecd1ec2b2ad1a350e7"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.916213 26301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:00.917450 26318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.917781 26301 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:00.917928 26301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "b10164f15c6946c38404c958ff933c31"
format_stamp: "Formatted at 2026-08-07 00:39:00 on dist-test-slave-csg5"
server_key: "2c395390101c2f2a4d5292aa6051e9e2"
server_key_iv: "ba15315e269fb9ecd1ec2b2ad1a350e7"
server_key_version: "encryptionkey@0"
I20260807 00:39:00.918036 26301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:00.935487 26301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:00.938202 26301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:00.938512 26301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:00.938874 26301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:00.939227 26301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:00.939286 26301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.939359 26301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:00.939391 26301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:00.945699 26301 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:36217
I20260807 00:39:00.945755 26438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:36217 every 8 connection(s)
I20260807 00:39:00.946113 26301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
Aug 07 00:39:00 dist-test-slave-csg5 krb5kdc[25906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:00.954182 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26301
I20260807 00:39:00.954305 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:39:00.954599 8176 external_mini_cluster.cc:1428] Setting key 061379ba3a3605006778b8804a7bc3c8
I20260807 00:39:00.958031 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.947065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:41381 (local address 127.7.252.62:43197)
0807 00:39:00.947239 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.947241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.947421 (+ 180us) server_negotiation.cc:407] Connection header received
0807 00:39:00.947930 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.947931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.947942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.948007 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:00.949138 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.949748 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.951087 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.951292 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.951360 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.954021 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:00.954023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:00.954024 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:00.954035 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:00.956128 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.956740 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.956742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.956742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.956807 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.957164 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.957166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.957166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.957299 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:00.957376 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.957866 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.957956 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260807 00:39:00.958326 26441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.946996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43197 (local address 127.7.252.3:41381)
0807 00:39:00.947181 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:00.947328 (+ 147us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:00.947833 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:00.948096 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:00.948101 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:00.948825 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:00.949032 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.949037 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.949970 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.949970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.950987 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.950990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.951418 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.951419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.951541 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.952218 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:00.952227 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:00.953887 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:00.956311 (+ 2424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:00.956320 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:00.956322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:00.956596 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:00.956924 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:00.956926 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:00.956926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:00.957061 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:00.957516 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:00.957524 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:00.957667 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 00:39:00.957791 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 00:39:00.957950 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":103,"threads_started":1}
I20260807 00:39:00.959256 26439 heartbeater.cc:347] Connected to a master server at 127.7.252.62:43197
I20260807 00:39:00.959403 26439 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:00.959668 26439 heartbeater.cc:511] Master 127.7.252.62:43197 requested a full tablet report, sending...
I20260807 00:39:00.960176 25955 ts_manager.cc:194] Registered new tserver with Master: b10164f15c6946c38404c958ff933c31 (127.7.252.3:36217)
I20260807 00:39:00.960613 25955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:41381
I20260807 00:39:00.968137 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:39:00.977977 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.969881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45206 (local address 127.7.252.62:43197)
0807 00:39:00.969964 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.969966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.970010 (+ 44us) server_negotiation.cc:407] Connection header received
0807 00:39:00.970072 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.970072 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.970081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.970137 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:00.970822 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.971417 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.972184 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.972414 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.972497 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.974088 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:00.974090 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:00.974090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:00.974098 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:00.976388 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.976881 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.976882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.976883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.976952 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:00.977201 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:00.977202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:00.977202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:00.977496 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:00.977588 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.977814 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.977898 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:39:00.981786 25955 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:39:00.985294 25955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:39:00.994222 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.989470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:36859 (local address 127.0.0.1:40446)
0807 00:39:00.989753 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:00.989773 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:00.989843 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:00.990520 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:00.990521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:00.990523 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:00.990588 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.990590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.991652 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.991653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.992883 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.992886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.993867 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.993868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.993965 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.993980 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 00:39:00.994056 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 00:39:00.994116 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":40,"thread_start_us":82,"threads_started":1}
I20260807 00:39:00.994262 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.990002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40446 (local address 127.7.252.2:36859)
0807 00:39:00.990340 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.990345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.990358 (+ 13us) server_negotiation.cc:407] Connection header received
0807 00:39:00.990408 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.990412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.990428 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.990521 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:00.990745 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.991537 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.992989 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.993789 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.993868 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.993936 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.994089 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.994138 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":106,"threads_started":1}
I20260807 00:39:00.994541 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.989700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36392 (local address 127.7.252.3:36217)
0807 00:39:00.989938 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.989944 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.989958 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:39:00.990007 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.990010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.990029 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.990144 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:00.990353 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.991567 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.993226 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.993891 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.993961 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.994017 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.994265 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.994462 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":159,"threads_started":1}
I20260807 00:39:00.994776 26456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.990316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51886 (local address 127.7.252.1:33525)
0807 00:39:00.990525 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:00.990530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:00.990540 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:00.990578 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:00.990580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:00.990595 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:00.990709 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:00.990861 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.991925 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.993349 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.994198 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.994278 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.994338 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:00.994607 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 00:39:00.994673 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":95,"threads_started":1}
I20260807 00:39:00.994815 26453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.989555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:33525 (local address 127.0.0.1:51886)
0807 00:39:00.989950 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:00.989958 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:00.990025 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:00.990730 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:00.990731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:00.990733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:00.990795 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.990797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.992076 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.992077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.993216 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.993218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.994420 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.994421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.994513 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.994519 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 00:39:00.994572 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 00:39:00.994622 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":126,"threads_started":1}
I20260807 00:39:00.994963 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:00.989470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:36217 (local address 127.0.0.1:36392)
0807 00:39:00.989654 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:00.989768 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:00.989844 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:00.990158 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:00.990162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:00.990165 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:00.990255 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.990259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.991689 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.991691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.993108 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:00.993111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:00.994052 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:00.994053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:00.994109 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:00.994112 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:00.994157 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 00:39:00.994203 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":40,"thread_start_us":72,"threads_started":1}
I20260807 00:39:00.995667 26368 tablet_service.cc:1467] Processing CreateTablet for tablet c6716cf711324167976c16bfe0853fa3 (DEFAULT_TABLE table=test-table [id=8fee522051cb4843ba2ec391a695e537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:00.995678 26228 tablet_service.cc:1467] Processing CreateTablet for tablet c6716cf711324167976c16bfe0853fa3 (DEFAULT_TABLE table=test-table [id=8fee522051cb4843ba2ec391a695e537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:00.995695 26089 tablet_service.cc:1467] Processing CreateTablet for tablet c6716cf711324167976c16bfe0853fa3 (DEFAULT_TABLE table=test-table [id=8fee522051cb4843ba2ec391a695e537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:00.996069 26368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6716cf711324167976c16bfe0853fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:00.996073 26228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6716cf711324167976c16bfe0853fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:00.996073 26089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6716cf711324167976c16bfe0853fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:00.999197 26457 tablet_bootstrap.cc:492] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Bootstrap starting.
I20260807 00:39:00.999804 26459 tablet_bootstrap.cc:492] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: Bootstrap starting.
I20260807 00:39:00.999893 26457 tablet_bootstrap.cc:654] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:01.000113 26458 tablet_bootstrap.cc:492] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Bootstrap starting.
I20260807 00:39:01.000532 26457 log.cc:824] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:01.000605 26459 tablet_bootstrap.cc:654] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:01.000824 26458 tablet_bootstrap.cc:654] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:01.001287 26459 log.cc:824] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:01.001469 26457 tablet_bootstrap.cc:492] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: No bootstrap required, opened a new log
I20260807 00:39:01.001444 26458 log.cc:824] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:01.001542 26457 ts_tablet_manager.cc:1397] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:01.002226 26459 tablet_bootstrap.cc:492] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: No bootstrap required, opened a new log
I20260807 00:39:01.002315 26459 ts_tablet_manager.cc:1397] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:01.002264 26458 tablet_bootstrap.cc:492] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: No bootstrap required, opened a new log
I20260807 00:39:01.002499 26458 ts_tablet_manager.cc:1397] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:01.003392 26457 raft_consensus.cc:348] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.003546 26457 raft_consensus.cc:374] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:01.003571 26457 raft_consensus.cc:729] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b10164f15c6946c38404c958ff933c31, State: Initialized, Role: FOLLOWER
I20260807 00:39:01.003700 26457 consensus_queue.cc:260] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.003994 26439 heartbeater.cc:503] Master 127.7.252.62:43197 was elected leader, sending a full tablet report...
I20260807 00:39:01.004253 26457 ts_tablet_manager.cc:1428] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:01.004717 26459 raft_consensus.cc:348] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.004963 26459 raft_consensus.cc:374] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:01.005012 26459 raft_consensus.cc:729] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a55a48aca554d90b5118e613e0e65a1, State: Initialized, Role: FOLLOWER
I20260807 00:39:01.005156 26459 consensus_queue.cc:260] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.005227 26458 raft_consensus.cc:348] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.005427 26458 raft_consensus.cc:374] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:01.005481 26458 raft_consensus.cc:729] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59efbc943a21404a8880a60476e1a4df, State: Initialized, Role: FOLLOWER
I20260807 00:39:01.005488 26459 ts_tablet_manager.cc:1428] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 00:39:01.005515 26158 heartbeater.cc:503] Master 127.7.252.62:43197 was elected leader, sending a full tablet report...
I20260807 00:39:01.005625 26458 consensus_queue.cc:260] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.005977 26296 heartbeater.cc:503] Master 127.7.252.62:43197 was elected leader, sending a full tablet report...
I20260807 00:39:01.005955 26458 ts_tablet_manager.cc:1428] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260807 00:39:01.012421 26297 tablet.cc:2369] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:39:01.083243 26159 tablet.cc:2369] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:39:01.196828 26440 tablet.cc:2369] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:01.248284 26465 raft_consensus.cc:482] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:39:01.248509 26465 raft_consensus.cc:504] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.249212 26465 leader_election.cc:288] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b10164f15c6946c38404c958ff933c31 (127.7.252.3:36217), 5a55a48aca554d90b5118e613e0e65a1 (127.7.252.1:33525)
I20260807 00:39:01.252686 26298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.249192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:36217 (local address 127.7.252.2:47317)
0807 00:39:01.249377 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.249393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.249465 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.249638 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.249639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.249640 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:01.249721 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.249724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.250599 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.250600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.251545 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.251548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.252375 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.252377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.252466 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.252470 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:01.252536 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 00:39:01.252580 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":39}
I20260807 00:39:01.252717 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.249405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:47317 (local address 127.7.252.3:36217)
0807 00:39:01.249492 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.249494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.249507 (+ 13us) server_negotiation.cc:407] Connection header received
0807 00:39:01.249543 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.249545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.249559 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.249634 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:01.249924 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.250501 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.251665 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.252254 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.252316 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.252327 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.252568 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.252617 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 00:39:01.253014 26456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.249376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:36275 (local address 127.7.252.1:33525)
0807 00:39:01.249437 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.249440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.249522 (+ 82us) server_negotiation.cc:407] Connection header received
0807 00:39:01.249635 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.249636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.249651 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.249705 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:01.250075 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.250593 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.252064 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.252595 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.252662 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.252671 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.252896 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.252949 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 00:39:01.253113 26389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6716cf711324167976c16bfe0853fa3" candidate_uuid: "59efbc943a21404a8880a60476e1a4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b10164f15c6946c38404c958ff933c31" is_pre_election: true
I20260807 00:39:01.253264 26466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.249192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:33525 (local address 127.7.252.2:36275)
0807 00:39:01.249440 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.249453 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.249538 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.249743 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.249744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.249746 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:01.249963 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.249965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.250838 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.250844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.251960 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.251963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.252693 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.252694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.252776 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.252781 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:01.253120 (+ 339us) client_negotiation.cc:240] Negotiation successful
0807 00:39:01.253178 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":56,"thread_start_us":83,"threads_started":1}
I20260807 00:39:01.253331 26389 raft_consensus.cc:2454] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59efbc943a21404a8880a60476e1a4df in term 0.
I20260807 00:39:01.253567 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6716cf711324167976c16bfe0853fa3" candidate_uuid: "59efbc943a21404a8880a60476e1a4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a55a48aca554d90b5118e613e0e65a1" is_pre_election: true
I20260807 00:39:01.253615 26180 leader_election.cc:302] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59efbc943a21404a8880a60476e1a4df, b10164f15c6946c38404c958ff933c31; no voters:
I20260807 00:39:01.253726 26110 raft_consensus.cc:2454] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59efbc943a21404a8880a60476e1a4df in term 0.
I20260807 00:39:01.253790 26465 raft_consensus.cc:2781] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:39:01.253912 26465 raft_consensus.cc:482] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:39:01.253945 26465 raft_consensus.cc:3037] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:01.255017 26465 raft_consensus.cc:504] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.255162 26465 leader_election.cc:288] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [CANDIDATE]: Term 1 election: Requested vote from peers b10164f15c6946c38404c958ff933c31 (127.7.252.3:36217), 5a55a48aca554d90b5118e613e0e65a1 (127.7.252.1:33525)
I20260807 00:39:01.255461 26389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6716cf711324167976c16bfe0853fa3" candidate_uuid: "59efbc943a21404a8880a60476e1a4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b10164f15c6946c38404c958ff933c31"
I20260807 00:39:01.255590 26389 raft_consensus.cc:3037] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:01.255576 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6716cf711324167976c16bfe0853fa3" candidate_uuid: "59efbc943a21404a8880a60476e1a4df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a55a48aca554d90b5118e613e0e65a1"
I20260807 00:39:01.255705 26110 raft_consensus.cc:3037] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:01.256536 26110 raft_consensus.cc:2454] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59efbc943a21404a8880a60476e1a4df in term 1.
I20260807 00:39:01.256537 26389 raft_consensus.cc:2454] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59efbc943a21404a8880a60476e1a4df in term 1.
I20260807 00:39:01.256757 26181 leader_election.cc:302] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59efbc943a21404a8880a60476e1a4df, 5a55a48aca554d90b5118e613e0e65a1; no voters:
I20260807 00:39:01.256902 26465 raft_consensus.cc:2781] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:01.257076 26465 raft_consensus.cc:686] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 1 LEADER]: Becoming Leader. State: Replica: 59efbc943a21404a8880a60476e1a4df, State: Running, Role: LEADER
I20260807 00:39:01.257166 26465 consensus_queue.cc:237] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } }
I20260807 00:39:01.258224 25953 catalog_manager.cc:5495] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df reported cstate change: term changed from 0 to 1, leader changed from <none> to 59efbc943a21404a8880a60476e1a4df (127.7.252.2). New cstate: current_term: 1 leader_uuid: "59efbc943a21404a8880a60476e1a4df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59efbc943a21404a8880a60476e1a4df" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 } health_report { overall_health: UNKNOWN } } }
I20260807 00:39:01.281473 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.278720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40456 (local address 127.7.252.2:36859)
0807 00:39:01.278806 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.278808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.278865 (+ 57us) server_negotiation.cc:407] Connection header received
0807 00:39:01.278931 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.278932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.278953 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.279023 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:01.279188 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.279795 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.280650 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.280865 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.280925 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.281126 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:01.281235 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:01.281315 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.281363 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.281384 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:39:01.283510 26389 raft_consensus.cc:1261] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 1 FOLLOWER]: Refusing update from remote peer 59efbc943a21404a8880a60476e1a4df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:01.283931 26110 raft_consensus.cc:1261] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 1 FOLLOWER]: Refusing update from remote peer 59efbc943a21404a8880a60476e1a4df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:01.283932 26465 consensus_queue.cc:1035] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b10164f15c6946c38404c958ff933c31" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 36217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:01.284298 26465 consensus_queue.cc:1035] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a55a48aca554d90b5118e613e0e65a1" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 33525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:01.287556 26472 mvcc.cc:205] Tried to move back new op lower bound from 7315714626694311936 to 7315714626590502912. Current Snapshot: MvccSnapshot[applied={T|T < 7315714626694311936}]
I20260807 00:39:01.288548 26474 mvcc.cc:205] Tried to move back new op lower bound from 7315714626694311936 to 7315714626590502912. Current Snapshot: MvccSnapshot[applied={T|T < 7315714626694311936}]
I20260807 00:39:01.290611 25953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:01.290777 25953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:01.291685 25953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 384be37f6eb64df584985410a374640b: Sending DeleteTablet for 3 replicas of tablet c6716cf711324167976c16bfe0853fa3
I20260807 00:39:01.292112 26228 tablet_service.cc:1514] Processing DeleteTablet for tablet c6716cf711324167976c16bfe0853fa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:40446
I20260807 00:39:01.292112 26368 tablet_service.cc:1514] Processing DeleteTablet for tablet c6716cf711324167976c16bfe0853fa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:36392
I20260807 00:39:01.292258 26089 tablet_service.cc:1514] Processing DeleteTablet for tablet c6716cf711324167976c16bfe0853fa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:01 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:51886
I20260807 00:39:01.292665 26484 tablet_replica.cc:330] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1: stopping tablet replica
I20260807 00:39:01.292697 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26019
I20260807 00:39:01.292873 26484 raft_consensus.cc:2229] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:01.293061 26484 raft_consensus.cc:2258] T c6716cf711324167976c16bfe0853fa3 P 5a55a48aca554d90b5118e613e0e65a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:01.297515 26483 tablet_replica.cc:330] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: stopping tablet replica
I20260807 00:39:01.297719 26483 raft_consensus.cc:2229] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:39:01.297881 26483 raft_consensus.cc:2258] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:01.297914 26482 tablet_replica.cc:330] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: stopping tablet replica
I20260807 00:39:01.298448 26482 raft_consensus.cc:2229] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:01.298513 26483 ts_tablet_manager.cc:1905] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:01.298727 26482 raft_consensus.cc:2258] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:01.300606 26482 ts_tablet_manager.cc:1905] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:01.300773 26483 ts_tablet_manager.cc:1918] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:01.300863 26483 log.cc:1196] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/c6716cf711324167976c16bfe0853fa3
I20260807 00:39:01.301142 26483 ts_tablet_manager.cc:1939] T c6716cf711324167976c16bfe0853fa3 P 59efbc943a21404a8880a60476e1a4df: Deleting consensus metadata
I20260807 00:39:01.301612 25938 catalog_manager.cc:4841] TS 59efbc943a21404a8880a60476e1a4df (127.7.252.2:36859): tablet c6716cf711324167976c16bfe0853fa3 (table test-table [id=8fee522051cb4843ba2ec391a695e537]) successfully deleted
I20260807 00:39:01.302277 26482 ts_tablet_manager.cc:1918] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:01.302376 26482 log.cc:1196] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/c6716cf711324167976c16bfe0853fa3
I20260807 00:39:01.302749 26482 ts_tablet_manager.cc:1939] T c6716cf711324167976c16bfe0853fa3 P b10164f15c6946c38404c958ff933c31: Deleting consensus metadata
I20260807 00:39:01.303426 25939 catalog_manager.cc:4841] TS b10164f15c6946c38404c958ff933c31 (127.7.252.3:36217): tablet c6716cf711324167976c16bfe0853fa3 (table test-table [id=8fee522051cb4843ba2ec391a695e537]) successfully deleted
W20260807 00:39:01.305670 25940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:33525 (error 108)
I20260807 00:39:01.305912 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26163
I20260807 00:39:01.309702 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.309505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:33525 (local address 127.0.0.1:51896)
0807 00:39:01.309586 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.309650 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 00:39:01.309970 25940 catalog_manager.cc:4584] TS 5a55a48aca554d90b5118e613e0e65a1 (127.7.252.1:33525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c6716cf711324167976c16bfe0853fa3: Network error: Client connection negotiation failed: client connection to 127.7.252.1:33525: connect: Connection refused (error 111)
I20260807 00:39:01.314186 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26301
I20260807 00:39:01.320544 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 25919
2026-08-07T00:39:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2429 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T00:39:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:01Z Disabled control of system clock
I20260807 00:39:01.353572 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:33721
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:34595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:33721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:01.448988 26489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:01.449249 26489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:01.449275 26489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:01.450728 26489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:01.450793 26489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:01.450809 26489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:01.450825 26489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:01.450839 26489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:01.452447 26489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:33721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:33721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:01.452764 26489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:01.453117 26489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:01.459681 26497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:01.459676 26495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:01.459685 26494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:01.459951 26489 server_base.cc:1034] running on GCE node
I20260807 00:39:01.460218 26489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:01.460582 26489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:01.461746 26489 hybrid_clock.cc:648] HybridClock initialized: now 1786063141461695 us; error 77 us; skew 500 ppm
I20260807 00:39:01.463306 26489 webserver.cc:460] Webserver started at http://127.7.252.62:38115/ using document root <none> and password file <none>
I20260807 00:39:01.463579 26489 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:01.463629 26489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:01.463789 26489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:01.464965 26489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "a265fc875c30415fb34221de9680f682"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "ef9ae9153f31c8c0c16194660953b4f7"
server_key_iv: "0bba6b0a853da448046ee49a7caaadc4"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.465392 26489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "a265fc875c30415fb34221de9680f682"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "ef9ae9153f31c8c0c16194660953b4f7"
server_key_iv: "0bba6b0a853da448046ee49a7caaadc4"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.467021 26489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260807 00:39:01.468057 26503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.468420 26489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:01.468513 26489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "a265fc875c30415fb34221de9680f682"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "ef9ae9153f31c8c0c16194660953b4f7"
server_key_iv: "0bba6b0a853da448046ee49a7caaadc4"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.468619 26489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:01.485502 26489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:01.485908 26489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:01.486071 26489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:01.490725 26489 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:33721
I20260807 00:39:01.490777 26558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:33721 every 8 connection(s)
I20260807 00:39:01.491147 26489 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:01.492302 26559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:01.495276 26559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682: Bootstrap starting.
I20260807 00:39:01.496064 26559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:01.496438 26559 log.cc:824] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:01.497311 26559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682: No bootstrap required, opened a new log
I20260807 00:39:01.499357 26559 raft_consensus.cc:348] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a265fc875c30415fb34221de9680f682" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33721 } }
I20260807 00:39:01.499526 26559 raft_consensus.cc:374] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:01.499555 26559 raft_consensus.cc:729] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a265fc875c30415fb34221de9680f682, State: Initialized, Role: FOLLOWER
I20260807 00:39:01.499735 26559 consensus_queue.cc:260] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a265fc875c30415fb34221de9680f682" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33721 } }
I20260807 00:39:01.499876 26559 raft_consensus.cc:388] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:01.499928 26559 raft_consensus.cc:482] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:01.499995 26559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:01.500018 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26489
I20260807 00:39:01.500283 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:01.500520 8176 external_mini_cluster.cc:1428] Setting key c5b0c33f151be2eaeb4bbe4c23799edd
I20260807 00:39:01.500806 26559 raft_consensus.cc:504] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a265fc875c30415fb34221de9680f682" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33721 } }
I20260807 00:39:01.500948 26559 leader_election.cc:302] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a265fc875c30415fb34221de9680f682; no voters:
I20260807 00:39:01.501165 26559 leader_election.cc:288] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:01.501395 26563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:01.501528 26559 sys_catalog.cc:564] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:01.501543 26563 raft_consensus.cc:686] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [term 1 LEADER]: Becoming Leader. State: Replica: a265fc875c30415fb34221de9680f682, State: Running, Role: LEADER
I20260807 00:39:01.501819 26563 consensus_queue.cc:237] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a265fc875c30415fb34221de9680f682" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33721 } }
I20260807 00:39:01.502318 26563 sys_catalog.cc:455] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a265fc875c30415fb34221de9680f682. Latest consensus state: current_term: 1 leader_uuid: "a265fc875c30415fb34221de9680f682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a265fc875c30415fb34221de9680f682" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33721 } } }
I20260807 00:39:01.502408 26563 sys_catalog.cc:458] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:01.502485 26566 sys_catalog.cc:455] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a265fc875c30415fb34221de9680f682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a265fc875c30415fb34221de9680f682" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33721 } } }
I20260807 00:39:01.502576 26566 sys_catalog.cc:458] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:01.502641 26574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:01.503248 26574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:01.504719 26582 mvcc.cc:205] Tried to move back new op lower bound from 7315714627601248256 to 7315714627591774208. Current Snapshot: MvccSnapshot[applied={T|T < 7315714627601248256}]
I20260807 00:39:01.505119 26574 catalog_manager.cc:1347] Generated new cluster ID: 72ef6af5e5e54e439e968cfc2e171140
I20260807 00:39:01.505206 26574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:01.507897 26565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.501131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37416 (local address 127.7.252.62:33721)
0807 00:39:01.501402 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.501413 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.501454 (+ 41us) server_negotiation.cc:407] Connection header received
0807 00:39:01.501627 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.501634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.501799 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.501968 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:01.502389 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.504046 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.505444 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.506117 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.506256 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.507143 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:01.507147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:01.507148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:01.507370 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:01.507415 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:01.507431 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:01.507501 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.507571 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.507664 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":127,"threads_started":1}
I20260807 00:39:01.532860 26574 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:01.533515 26574 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:01.542704 26574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682: Generated new TSK 0
I20260807 00:39:01.542995 26574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:01.548622 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33721
--builtin_ntp_servers=127.7.252.20:34595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:01.641055 26584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:01.641295 26584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:01.641319 26584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:01.642573 26584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:01.642625 26584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:01.642705 26584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:39:01.644212 26584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:01.644505 26584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:01.644871 26584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:01.651221 26590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:01.651273 26591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:01.651260 26584 server_base.cc:1034] running on GCE node
W20260807 00:39:01.651228 26593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:01.651618 26584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:01.651935 26584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:01.653108 26584 hybrid_clock.cc:648] HybridClock initialized: now 1786063141653080 us; error 43 us; skew 500 ppm
I20260807 00:39:01.654623 26584 webserver.cc:460] Webserver started at http://127.7.252.1:46253/ using document root <none> and password file <none>
I20260807 00:39:01.654950 26584 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:01.655022 26584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:01.655153 26584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:01.656301 26584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "d07a6ade631e48a08abc78e4c691e2e9"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "b6d1b950f10cc5ecc74a30449e3541b5"
server_key_iv: "40123c3301af080ab187c619ff9a7195"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.656610 26584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "d07a6ade631e48a08abc78e4c691e2e9"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "b6d1b950f10cc5ecc74a30449e3541b5"
server_key_iv: "40123c3301af080ab187c619ff9a7195"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.657986 26584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:01.658877 26599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.659188 26584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:01.659296 26584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "d07a6ade631e48a08abc78e4c691e2e9"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "b6d1b950f10cc5ecc74a30449e3541b5"
server_key_iv: "40123c3301af080ab187c619ff9a7195"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.659394 26584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:01.678027 26584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:01.678418 26584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:01.678594 26584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:01.678889 26584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:01.679270 26584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:01.679340 26584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.679383 26584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:01.679414 26584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.685637 26584 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42427
I20260807 00:39:01.685737 26718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42427 every 8 connection(s)
I20260807 00:39:01.686113 26584 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:39:01.692957 26565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.687096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:39063 (local address 127.7.252.62:33721)
0807 00:39:01.687194 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.687196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.687614 (+ 418us) server_negotiation.cc:407] Connection header received
0807 00:39:01.688016 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.688017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.688033 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.688105 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:01.689049 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.689666 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.690887 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.691103 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.691171 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.692598 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:01.692599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:01.692599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:01.692609 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:01.692628 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:01.692632 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:01.692704 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.692844 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.692882 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 00:39:01.693408 26721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.687013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33721 (local address 127.7.252.1:39063)
0807 00:39:01.687223 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.687276 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.687858 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.688248 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.688252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.688262 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:01.688876 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.688883 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.689825 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.689827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.690778 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.690781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.691408 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.691411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.691582 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.692350 (+ 768us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:01.692351 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:01.692385 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:01.692414 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:01.692742 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:01.692750 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:01.692753 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:01.692854 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 00:39:01.692968 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260807 00:39:01.694098 26719 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33721
I20260807 00:39:01.694198 26719 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:01.694448 26719 heartbeater.cc:511] Master 127.7.252.62:33721 requested a full tablet report, sending...
I20260807 00:39:01.695142 26520 ts_manager.cc:194] Registered new tserver with Master: d07a6ade631e48a08abc78e4c691e2e9 (127.7.252.1:42427)
I20260807 00:39:01.695667 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26584
I20260807 00:39:01.695758 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:39:01.696033 8176 external_mini_cluster.cc:1428] Setting key 9cfb937adb26efc6ed601a6eb41f6b9f
I20260807 00:39:01.696102 26520 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.1:39063
I20260807 00:39:01.697247 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33721
--builtin_ntp_servers=127.7.252.20:34595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:01.786949 26722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:01.787182 26722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:01.787206 26722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:01.788498 26722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:01.788574 26722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:01.788620 26722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:39:01.790947 26722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:01.791257 26722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:01.791648 26722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:01.797291 26731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:01.797389 26729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:01.797448 26722 server_base.cc:1034] running on GCE node
W20260807 00:39:01.797437 26728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:01.797904 26722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:01.798215 26722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:01.799417 26722 hybrid_clock.cc:648] HybridClock initialized: now 1786063141799396 us; error 32 us; skew 500 ppm
I20260807 00:39:01.800843 26722 webserver.cc:460] Webserver started at http://127.7.252.2:37031/ using document root <none> and password file <none>
I20260807 00:39:01.801287 26722 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:01.801350 26722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:01.801502 26722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:01.802937 26722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "293fa8e0c04d413f92ef9a8381a9f94d"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "99045722587575dec5e8c80659911714"
server_key_iv: "9f1ba978b3d199a1125bf56cb486c563"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.803342 26722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "293fa8e0c04d413f92ef9a8381a9f94d"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "99045722587575dec5e8c80659911714"
server_key_iv: "9f1ba978b3d199a1125bf56cb486c563"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.804876 26722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:01.805908 26737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.806139 26722 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:01.806241 26722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "293fa8e0c04d413f92ef9a8381a9f94d"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "99045722587575dec5e8c80659911714"
server_key_iv: "9f1ba978b3d199a1125bf56cb486c563"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.806303 26722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:01.817996 26722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:01.818328 26722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:01.818442 26722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:01.818704 26722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:01.819121 26722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:01.819165 26722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.819190 26722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:01.819202 26722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.826079 26722 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:34599
I20260807 00:39:01.826195 26855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:34599 every 8 connection(s)
I20260807 00:39:01.826567 26722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:39:01.832768 26565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.827515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:41967 (local address 127.7.252.62:33721)
0807 00:39:01.827594 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.827596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.827866 (+ 270us) server_negotiation.cc:407] Connection header received
0807 00:39:01.828434 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.828436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.828448 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.828513 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:01.829405 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.829928 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.831099 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.831408 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.831487 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.832395 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:01.832397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:01.832397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:01.832402 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:01.832430 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:01.832435 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:01.832496 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.832665 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.832700 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:39:01.833083 26858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.827464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33721 (local address 127.7.252.2:41967)
0807 00:39:01.827678 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.827719 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.828267 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.828596 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.828600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.828610 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:01.829184 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.829188 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.830047 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.830048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.830994 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.830997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.831510 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.831510 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.831633 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.832220 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:01.832220 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:01.832250 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:01.832276 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:01.832533 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:01.832540 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:01.832543 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:01.832629 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 00:39:01.832727 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
I20260807 00:39:01.833668 26856 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33721
I20260807 00:39:01.833803 26856 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:01.833933 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26722
I20260807 00:39:01.834028 26856 heartbeater.cc:511] Master 127.7.252.62:33721 requested a full tablet report, sending...
I20260807 00:39:01.834043 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:39:01.834257 8176 external_mini_cluster.cc:1428] Setting key b32e7d08725f5ff4efc2e22c73bb3d3e
I20260807 00:39:01.834478 26520 ts_manager.cc:194] Registered new tserver with Master: 293fa8e0c04d413f92ef9a8381a9f94d (127.7.252.2:34599)
I20260807 00:39:01.835186 26520 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.2:41967
I20260807 00:39:01.835459 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33721
--builtin_ntp_servers=127.7.252.20:34595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:01.928440 26859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:01.928769 26859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:01.928815 26859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:01.930370 26859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:01.930745 26859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:01.930876 26859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:39:01.932610 26859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:01.932929 26859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:01.933276 26859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:01.939203 26864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:01.939363 26865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:01.939378 26867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:01.940235 26859 server_base.cc:1034] running on GCE node
I20260807 00:39:01.940745 26859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:01.941077 26859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:01.942267 26859 hybrid_clock.cc:648] HybridClock initialized: now 1786063141942249 us; error 44 us; skew 500 ppm
I20260807 00:39:01.943979 26859 webserver.cc:460] Webserver started at http://127.7.252.3:33899/ using document root <none> and password file <none>
I20260807 00:39:01.944269 26859 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:01.944324 26859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:01.944475 26859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:01.945756 26859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "db95dc7572a247e9bd9d9532aedd1b56"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "ecf8c544d91f3e85dd8048541e275274"
server_key_iv: "54879ab8733a5d5d7dd7f6bbe50597ae"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.946169 26859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "db95dc7572a247e9bd9d9532aedd1b56"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "ecf8c544d91f3e85dd8048541e275274"
server_key_iv: "54879ab8733a5d5d7dd7f6bbe50597ae"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.947817 26859 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:01.948868 26873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.949128 26859 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:01.949263 26859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "db95dc7572a247e9bd9d9532aedd1b56"
format_stamp: "Formatted at 2026-08-07 00:39:01 on dist-test-slave-csg5"
server_key: "ecf8c544d91f3e85dd8048541e275274"
server_key_iv: "54879ab8733a5d5d7dd7f6bbe50597ae"
server_key_version: "encryptionkey@0"
I20260807 00:39:01.949368 26859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:01.962906 26859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:01.963294 26859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:01.963483 26859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:01.963781 26859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:01.964161 26859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:01.964229 26859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.964270 26859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:01.964325 26859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:01.971293 26859 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:40215
I20260807 00:39:01.971340 26990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:40215 every 8 connection(s)
I20260807 00:39:01.971812 26859 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:39:01.978785 26565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.972654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:49575 (local address 127.7.252.62:33721)
0807 00:39:01.972707 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.972709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.973020 (+ 311us) server_negotiation.cc:407] Connection header received
0807 00:39:01.973587 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.973589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.973601 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.973658 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:01.974383 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.974979 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.976250 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.976455 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.976534 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.978102 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:01.978104 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:01.978104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:01.978110 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:01.978127 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:01.978132 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:01.978382 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.978605 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.978648 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:39:01.979085 26993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.972626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33721 (local address 127.7.252.3:49575)
0807 00:39:01.972836 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.972906 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.973445 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.973723 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.973726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.973736 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:01.974258 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.974263 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.975252 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.975253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.976070 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.976072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.976616 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.976617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:01.976781 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.977768 (+ 987us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:01.977770 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:01.977909 (+ 139us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:01.977945 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:01.978378 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:01.978385 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:01.978388 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:01.978577 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 00:39:01.978778 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260807 00:39:01.979862 26991 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33721
I20260807 00:39:01.979981 26991 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:01.980254 26991 heartbeater.cc:511] Master 127.7.252.62:33721 requested a full tablet report, sending...
I20260807 00:39:01.981195 26520 ts_manager.cc:194] Registered new tserver with Master: db95dc7572a247e9bd9d9532aedd1b56 (127.7.252.3:40215)
I20260807 00:39:01.981719 26520 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.3:49575
I20260807 00:39:01.982129 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 26859
I20260807 00:39:01.982221 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:39:01.982422 8176 external_mini_cluster.cc:1428] Setting key c6d2ef6ef33514aff7aa627e340d785e
I20260807 00:39:01.983599 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:39:01.989480 26565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.985301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37428 (local address 127.7.252.62:33721)
0807 00:39:01.985405 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.985407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.985558 (+ 151us) server_negotiation.cc:407] Connection header received
0807 00:39:01.985605 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.985606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.985636 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.985712 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:01.986010 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.986615 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.987831 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.988036 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.988100 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:01.989063 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:01.989064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:01.989064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:01.989071 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:01.989088 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:01.989093 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:01.989154 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:01.989376 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 00:39:01.989409 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 00:39:01.992198 26520 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:39:01.993944 26520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:39:02.003153 27001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.997725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40215 (local address 127.0.0.1:59354)
0807 00:39:01.997899 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.997952 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.998033 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.998874 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.998875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.998878 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:01.998948 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.998950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.999927 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:01.999928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.001427 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.001430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.002801 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.002802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.002868 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.002876 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 00:39:02.002914 (+ 38us) client_negotiation.cc:240] Negotiation successful
0807 00:39:02.002983 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":5,"thread_start_us":72,"threads_started":1}
I20260807 00:39:02.003157 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.997730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:34599 (local address 127.0.0.1:39904)
0807 00:39:01.998087 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.998100 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.998157 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.998532 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.998536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.998539 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:01.998638 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.998642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.000367 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.000368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.001560 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.001562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.002509 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.002510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.002615 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.002632 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 00:39:02.002879 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 00:39:02.002965 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":67,"threads_started":1}
I20260807 00:39:02.003320 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.998047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39904 (local address 127.7.252.2:34599)
0807 00:39:01.998301 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.998307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.998318 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:39:01.998365 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.998368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.998386 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.998843 (+ 457us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:01.998913 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.000243 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.001667 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.002390 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.002505 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.002643 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:02.003101 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 00:39:02.003151 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":113,"threads_started":1}
I20260807 00:39:02.003469 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.997982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42427 (local address 127.0.0.1:55464)
0807 00:39:01.998141 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:01.998150 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:01.998189 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:01.998922 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:01.998923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:01.998925 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:01.998975 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:01.998976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.000413 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.000414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.001569 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.001572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.002789 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.002791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.002868 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.002874 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 00:39:02.002933 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 00:39:02.002984 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":5,"thread_start_us":48,"threads_started":1}
I20260807 00:39:02.003775 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.998405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.7.252.1:42427)
0807 00:39:01.998633 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.998638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.998688 (+ 50us) server_negotiation.cc:407] Connection header received
0807 00:39:01.998734 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.998737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.998754 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.998846 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:01.999060 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.000306 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.001679 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.002535 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.002619 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.002746 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:02.003617 (+ 871us) server_negotiation.cc:299] Negotiation successful
0807 00:39:02.003681 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":90,"threads_started":1}
I20260807 00:39:02.004259 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:01.998145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59354 (local address 127.7.252.3:40215)
0807 00:39:01.998594 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:01.998599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:01.998611 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:39:01.998685 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:01.998688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:01.998706 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:01.998795 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:01.999043 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:01.999818 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.001545 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.002534 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.003041 (+ 507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.004121 (+ 1080us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:02.004147 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 00:39:02.004186 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":133,"threads_started":1}
I20260807 00:39:02.004264 26786 tablet_service.cc:1467] Processing CreateTablet for tablet 68a1f356de514c0fa02638ec7a08d124 (DEFAULT_TABLE table=test-table [id=c8881e4c36a544dd955d1bbdade866a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:02.004420 26649 tablet_service.cc:1467] Processing CreateTablet for tablet 68a1f356de514c0fa02638ec7a08d124 (DEFAULT_TABLE table=test-table [id=c8881e4c36a544dd955d1bbdade866a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:02.004690 26786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a1f356de514c0fa02638ec7a08d124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:02.004755 26649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a1f356de514c0fa02638ec7a08d124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:02.007368 26923 tablet_service.cc:1467] Processing CreateTablet for tablet 68a1f356de514c0fa02638ec7a08d124 (DEFAULT_TABLE table=test-table [id=c8881e4c36a544dd955d1bbdade866a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:02.007814 26923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a1f356de514c0fa02638ec7a08d124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:02.008608 27008 tablet_bootstrap.cc:492] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9: Bootstrap starting.
I20260807 00:39:02.009490 27008 tablet_bootstrap.cc:654] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:02.009891 27008 log.cc:824] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:02.010335 27007 tablet_bootstrap.cc:492] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Bootstrap starting.
I20260807 00:39:02.011045 27008 tablet_bootstrap.cc:492] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9: No bootstrap required, opened a new log
I20260807 00:39:02.011149 27008 ts_tablet_manager.cc:1397] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:02.011284 27007 tablet_bootstrap.cc:654] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:02.011680 27007 log.cc:824] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:02.012125 27010 tablet_bootstrap.cc:492] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Bootstrap starting.
I20260807 00:39:02.012545 27007 tablet_bootstrap.cc:492] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: No bootstrap required, opened a new log
I20260807 00:39:02.012645 27007 ts_tablet_manager.cc:1397] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 00:39:02.012940 27010 tablet_bootstrap.cc:654] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:02.013293 27010 log.cc:824] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:02.014294 27010 tablet_bootstrap.cc:492] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: No bootstrap required, opened a new log
I20260807 00:39:02.014374 27010 ts_tablet_manager.cc:1397] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:02.014191 27008 raft_consensus.cc:348] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.014423 27008 raft_consensus.cc:374] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:02.014482 27008 raft_consensus.cc:729] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07a6ade631e48a08abc78e4c691e2e9, State: Initialized, Role: FOLLOWER
I20260807 00:39:02.014631 27008 consensus_queue.cc:260] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.014978 27008 ts_tablet_manager.cc:1428] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 00:39:02.015136 26719 heartbeater.cc:503] Master 127.7.252.62:33721 was elected leader, sending a full tablet report...
I20260807 00:39:02.015306 27007 raft_consensus.cc:348] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.015475 27007 raft_consensus.cc:374] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:02.015522 27007 raft_consensus.cc:729] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa8e0c04d413f92ef9a8381a9f94d, State: Initialized, Role: FOLLOWER
I20260807 00:39:02.015666 27007 consensus_queue.cc:260] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.015961 27007 ts_tablet_manager.cc:1428] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260807 00:39:02.015966 26856 heartbeater.cc:503] Master 127.7.252.62:33721 was elected leader, sending a full tablet report...
I20260807 00:39:02.017731 27010 raft_consensus.cc:348] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.017901 27010 raft_consensus.cc:374] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:02.017926 27010 raft_consensus.cc:729] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db95dc7572a247e9bd9d9532aedd1b56, State: Initialized, Role: FOLLOWER
I20260807 00:39:02.018051 27010 consensus_queue.cc:260] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.018308 27010 ts_tablet_manager.cc:1428] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 00:39:02.018389 26991 heartbeater.cc:503] Master 127.7.252.62:33721 was elected leader, sending a full tablet report...
I20260807 00:39:02.050239 27013 raft_consensus.cc:482] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:39:02.050416 27013 raft_consensus.cc:504] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.051043 27013 leader_election.cc:288] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293fa8e0c04d413f92ef9a8381a9f94d (127.7.252.2:34599), db95dc7572a247e9bd9d9532aedd1b56 (127.7.252.3:40215)
I20260807 00:39:02.054741 26721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:02.051249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:34599 (local address 127.7.252.1:39061)
0807 00:39:02.051324 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:02.051339 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:02.051397 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:02.051596 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:02.051597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:02.051600 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:02.051684 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.051687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.052812 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.052814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.053699 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.053702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.054371 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.054373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.054454 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.054458 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:02.054564 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 00:39:02.054620 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 00:39:02.054741 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:02.051356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:39061 (local address 127.7.252.2:34599)
0807 00:39:02.051430 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:02.051432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:02.051444 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:39:02.051478 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:02.051479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:02.051491 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:02.051554 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:02.051836 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.052651 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.053864 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.054270 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.054370 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.054381 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:02.054574 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 00:39:02.054620 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:39:02.054850 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:02.051393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:60455 (local address 127.7.252.3:40215)
0807 00:39:02.051533 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:02.051535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:02.051606 (+ 71us) server_negotiation.cc:407] Connection header received
0807 00:39:02.051675 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:02.051676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:02.051686 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:02.051748 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:02.052046 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.052761 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.053992 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.054436 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.054527 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.054536 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:02.054737 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 00:39:02.054783 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260807 00:39:02.054864 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:02.051249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:40215 (local address 127.7.252.1:60455)
0807 00:39:02.051533 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:02.051544 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:02.051601 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:02.051835 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:02.051836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:02.051839 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:02.051913 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.051914 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.052849 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.052851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.053883 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:02.053887 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.054529 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.054530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:02.054608 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.054614 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 00:39:02.054727 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 00:39:02.054770 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":31,"thread_start_us":117,"threads_started":1}
I20260807 00:39:02.055256 26944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a1f356de514c0fa02638ec7a08d124" candidate_uuid: "d07a6ade631e48a08abc78e4c691e2e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db95dc7572a247e9bd9d9532aedd1b56" is_pre_election: true
I20260807 00:39:02.055245 26807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a1f356de514c0fa02638ec7a08d124" candidate_uuid: "d07a6ade631e48a08abc78e4c691e2e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" is_pre_election: true
I20260807 00:39:02.055437 26944 raft_consensus.cc:2454] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d07a6ade631e48a08abc78e4c691e2e9 in term 0.
I20260807 00:39:02.055437 26807 raft_consensus.cc:2454] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d07a6ade631e48a08abc78e4c691e2e9 in term 0.
I20260807 00:39:02.055758 26601 leader_election.cc:302] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa8e0c04d413f92ef9a8381a9f94d, d07a6ade631e48a08abc78e4c691e2e9; no voters:
I20260807 00:39:02.055933 27013 raft_consensus.cc:2781] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:39:02.056023 27013 raft_consensus.cc:482] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:39:02.056062 27013 raft_consensus.cc:3037] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:02.056850 27013 raft_consensus.cc:504] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.057047 27013 leader_election.cc:288] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [CANDIDATE]: Term 1 election: Requested vote from peers 293fa8e0c04d413f92ef9a8381a9f94d (127.7.252.2:34599), db95dc7572a247e9bd9d9532aedd1b56 (127.7.252.3:40215)
I20260807 00:39:02.057222 26944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a1f356de514c0fa02638ec7a08d124" candidate_uuid: "d07a6ade631e48a08abc78e4c691e2e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db95dc7572a247e9bd9d9532aedd1b56"
I20260807 00:39:02.057333 26944 raft_consensus.cc:3037] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:02.057246 26807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a1f356de514c0fa02638ec7a08d124" candidate_uuid: "d07a6ade631e48a08abc78e4c691e2e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa8e0c04d413f92ef9a8381a9f94d"
I20260807 00:39:02.057451 26807 raft_consensus.cc:3037] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:02.058307 26944 raft_consensus.cc:2454] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d07a6ade631e48a08abc78e4c691e2e9 in term 1.
I20260807 00:39:02.058430 26807 raft_consensus.cc:2454] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d07a6ade631e48a08abc78e4c691e2e9 in term 1.
I20260807 00:39:02.058610 26600 leader_election.cc:302] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d07a6ade631e48a08abc78e4c691e2e9, db95dc7572a247e9bd9d9532aedd1b56; no voters:
I20260807 00:39:02.058772 27013 raft_consensus.cc:2781] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:02.058948 27013 raft_consensus.cc:686] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [term 1 LEADER]: Becoming Leader. State: Replica: d07a6ade631e48a08abc78e4c691e2e9, State: Running, Role: LEADER
I20260807 00:39:02.059067 27013 consensus_queue.cc:237] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } }
I20260807 00:39:02.060070 26520 catalog_manager.cc:5495] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d07a6ade631e48a08abc78e4c691e2e9 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "d07a6ade631e48a08abc78e4c691e2e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d07a6ade631e48a08abc78e4c691e2e9" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 } health_report { overall_health: UNKNOWN } } }
W20260807 00:39:02.077279 26857 tablet.cc:2369] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:02.079293 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:02.076112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55470 (local address 127.7.252.1:42427)
0807 00:39:02.076249 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:02.076251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:02.076260 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:02.076305 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:02.076306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:02.076329 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:02.076404 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:02.076597 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.077136 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.078387 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:02.078603 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:02.078715 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:02.078930 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:02.079045 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:02.079115 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:02.079170 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 00:39:02.079193 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:39:02.081573 26807 raft_consensus.cc:1261] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 1 FOLLOWER]: Refusing update from remote peer d07a6ade631e48a08abc78e4c691e2e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:02.081583 26944 raft_consensus.cc:1261] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 1 FOLLOWER]: Refusing update from remote peer d07a6ade631e48a08abc78e4c691e2e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:02.082110 27017 consensus_queue.cc:1035] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db95dc7572a247e9bd9d9532aedd1b56" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 40215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:02.082351 27013 consensus_queue.cc:1035] T 68a1f356de514c0fa02638ec7a08d124 P d07a6ade631e48a08abc78e4c691e2e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa8e0c04d413f92ef9a8381a9f94d" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:02.085952 27020 mvcc.cc:205] Tried to move back new op lower bound from 7315714629962801152 to 7315714629874671616. Current Snapshot: MvccSnapshot[applied={T|T < 7315714629962801152}]
I20260807 00:39:02.086755 27021 mvcc.cc:205] Tried to move back new op lower bound from 7315714629962801152 to 7315714629874671616. Current Snapshot: MvccSnapshot[applied={T|T < 7315714629962801152}]
I20260807 00:39:02.088976 26519 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:02.089099 26519 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:02.090114 26519 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a265fc875c30415fb34221de9680f682: Sending DeleteTablet for 3 replicas of tablet 68a1f356de514c0fa02638ec7a08d124
I20260807 00:39:02.090584 26923 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a1f356de514c0fa02638ec7a08d124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:02 UTC) from {username='slave'} at 127.0.0.1:59354
I20260807 00:39:02.090598 26786 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a1f356de514c0fa02638ec7a08d124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:02 UTC) from {username='slave'} at 127.0.0.1:39904
I20260807 00:39:02.090948 26649 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a1f356de514c0fa02638ec7a08d124 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:02 UTC) from {username='slave'} at 127.0.0.1:55464
I20260807 00:39:02.091019 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26584
I20260807 00:39:02.091109 27032 tablet_replica.cc:330] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: stopping tablet replica
I20260807 00:39:02.091220 27032 raft_consensus.cc:2229] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:02.091334 27032 raft_consensus.cc:2258] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:02.092003 27033 tablet_replica.cc:330] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: stopping tablet replica
I20260807 00:39:02.092113 27033 raft_consensus.cc:2229] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:02.092202 27033 raft_consensus.cc:2258] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:02.093941 27032 ts_tablet_manager.cc:1905] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:02.095163 27033 ts_tablet_manager.cc:1905] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:02.096371 27032 ts_tablet_manager.cc:1918] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:02.096463 27032 log.cc:1196] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/68a1f356de514c0fa02638ec7a08d124
I20260807 00:39:02.096731 27032 ts_tablet_manager.cc:1939] T 68a1f356de514c0fa02638ec7a08d124 P 293fa8e0c04d413f92ef9a8381a9f94d: Deleting consensus metadata
I20260807 00:39:02.096930 27033 ts_tablet_manager.cc:1918] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:02.097023 27033 log.cc:1196] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/68a1f356de514c0fa02638ec7a08d124
I20260807 00:39:02.097241 26505 catalog_manager.cc:4841] TS 293fa8e0c04d413f92ef9a8381a9f94d (127.7.252.2:34599): tablet 68a1f356de514c0fa02638ec7a08d124 (table test-table [id=c8881e4c36a544dd955d1bbdade866a9]) successfully deleted
I20260807 00:39:02.097479 27033 ts_tablet_manager.cc:1939] T 68a1f356de514c0fa02638ec7a08d124 P db95dc7572a247e9bd9d9532aedd1b56: Deleting consensus metadata
I20260807 00:39:02.097925 26504 catalog_manager.cc:4841] TS db95dc7572a247e9bd9d9532aedd1b56 (127.7.252.3:40215): tablet 68a1f356de514c0fa02638ec7a08d124 (table test-table [id=c8881e4c36a544dd955d1bbdade866a9]) successfully deleted
W20260807 00:39:02.099684 26505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:42427 (error 108)
I20260807 00:39:02.099824 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26722
I20260807 00:39:02.102208 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:02.102029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42427 (local address 127.0.0.1:55482)
0807 00:39:02.102100 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:02.102162 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42427: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 00:39:02.102447 26505 catalog_manager.cc:4584] TS d07a6ade631e48a08abc78e4c691e2e9 (127.7.252.1:42427): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68a1f356de514c0fa02638ec7a08d124: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42427: connect: Connection refused (error 111)
I20260807 00:39:02.107520 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26859
I20260807 00:39:02.115247 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 26489
2026-08-07T00:39:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (792 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:02 dist-test-slave-csg5 krb5kdc[27037](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:02 dist-test-slave-csg5 krb5kdc[27037](info): set up 2 sockets
Aug 07 00:39:02 dist-test-slave-csg5 krb5kdc[27037](info): commencing operation
krb5kdc: starting...
W20260807 00:39:03.267839 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:03.402781 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41687
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41687
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:03.492530 27051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:03.492825 27051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:03.492870 27051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:03.494155 27051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:03.494240 27051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:03.494264 27051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:03.494287 27051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:03.494324 27051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:03.496022 27051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:03.496343 27051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:03.496595 27051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:03.502079 27059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:03.502079 27056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:03.502074 27057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:03.502305 27051 server_base.cc:1034] running on GCE node
I20260807 00:39:03.502890 27051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:03.503185 27051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:03.504380 27051 hybrid_clock.cc:648] HybridClock initialized: now 1786063143504353 us; error 49 us; skew 500 ppm
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:03.507334 27051 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:03.507893 27051 webserver.cc:460] Webserver started at http://127.7.252.62:37713/ using document root <none> and password file <none>
I20260807 00:39:03.508155 27051 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:03.508241 27051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:03.508404 27051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:03.509529 27051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "585ad02e44ba4ff2b3591a92888d3c0d"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "1942a200af2c52d3f26080871d544cd4"
server_key_iv: "142eae1570f36ee7d9494f63f549ebbe"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.509923 27051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "585ad02e44ba4ff2b3591a92888d3c0d"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "1942a200af2c52d3f26080871d544cd4"
server_key_iv: "142eae1570f36ee7d9494f63f549ebbe"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.511523 27051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:03.512521 27066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.512892 27051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:03.513015 27051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "585ad02e44ba4ff2b3591a92888d3c0d"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "1942a200af2c52d3f26080871d544cd4"
server_key_iv: "142eae1570f36ee7d9494f63f549ebbe"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.513100 27051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:03.541704 27051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:03.544003 27051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:03.544189 27051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:03.548753 27051 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41687
I20260807 00:39:03.548801 27124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41687 every 8 connection(s)
I20260807 00:39:03.549201 27051 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:03.549638 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27051
I20260807 00:39:03.549800 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:03.550006 8176 external_mini_cluster.cc:1428] Setting key 3368882a850678f9d84aaaad377e66fe
I20260807 00:39:03.550312 27125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:03.553905 27125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d: Bootstrap starting.
I20260807 00:39:03.554636 27125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:03.555068 27125 log.cc:824] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:03.556059 27125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d: No bootstrap required, opened a new log
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:03.558248 27125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41687 } }
I20260807 00:39:03.558461 27125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:03.558509 27125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585ad02e44ba4ff2b3591a92888d3c0d, State: Initialized, Role: FOLLOWER
I20260807 00:39:03.558708 27125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41687 } }
I20260807 00:39:03.558816 27125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:03.558889 27125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:03.558975 27125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:03.559892 27125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41687 } }
I20260807 00:39:03.560021 27125 leader_election.cc:302] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 585ad02e44ba4ff2b3591a92888d3c0d; no voters:
I20260807 00:39:03.560218 27125 leader_election.cc:288] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:03.560511 27125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:03.560591 27130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:03.560861 27130 raft_consensus.cc:686] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [term 1 LEADER]: Becoming Leader. State: Replica: 585ad02e44ba4ff2b3591a92888d3c0d, State: Running, Role: LEADER
I20260807 00:39:03.561029 27130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41687 } }
I20260807 00:39:03.561502 27132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41687 } } }
I20260807 00:39:03.561648 27132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:03.561492 27130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 585ad02e44ba4ff2b3591a92888d3c0d. Latest consensus state: current_term: 1 leader_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "585ad02e44ba4ff2b3591a92888d3c0d" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41687 } } }
I20260807 00:39:03.562101 27143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:03.562214 27130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:03.562844 27143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:03.563090 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:03.550637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.7.252.62:41687)
0807 00:39:03.550870 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:03.550880 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:03.550917 (+ 37us) server_negotiation.cc:407] Connection header received
0807 00:39:03.551603 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:03.551613 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:03.551680 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:03.551855 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:03.552535 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.553910 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.554954 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.555514 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.555655 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:03.558195 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:03.558200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:03.558200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:03.558216 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:03.560617 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:03.561300 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:03.561304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:03.561305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:03.561522 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:03.561810 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:03.561811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:03.561812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:03.562177 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:03.562318 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:03.562643 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 00:39:03.562862 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":107,"threads_started":1}
I20260807 00:39:03.568262 27143 catalog_manager.cc:1347] Generated new cluster ID: 616e66c5d2364c3f9126de273d8bd235
I20260807 00:39:03.568346 27143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:03.578504 27143 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:03.579350 27143 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:03.587188 27143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d: Generated new TSK 0
I20260807 00:39:03.587462 27143 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:39:03.626179 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41687
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:03.714160 27151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:03.714409 27151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:03.714437 27151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:03.715843 27151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:03.715914 27151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:03.715945 27151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:39:03.717969 27151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:03.718297 27151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:03.718568 27151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:03.724689 27157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:03.725023 27156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:03.724689 27159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:03.725811 27151 server_base.cc:1034] running on GCE node
I20260807 00:39:03.726049 27151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:03.726337 27151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:03.727579 27151 hybrid_clock.cc:648] HybridClock initialized: now 1786063143727519 us; error 81 us; skew 500 ppm
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:03.731061 27151 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:39:03.731649 27151 webserver.cc:460] Webserver started at http://127.7.252.1:45773/ using document root <none> and password file <none>
I20260807 00:39:03.731932 27151 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:03.732025 27151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:03.732195 27151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:03.733431 27151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "d526188c3d4c4b69b8be93b7d45d7249"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "950db3f97627dac852aac5630e3a319e"
server_key_iv: "b536b1c24d3b0ca06183e6a2aebbff0d"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.733832 27151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "d526188c3d4c4b69b8be93b7d45d7249"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "950db3f97627dac852aac5630e3a319e"
server_key_iv: "b536b1c24d3b0ca06183e6a2aebbff0d"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.735404 27151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:03.736379 27167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.736660 27151 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:03.736822 27151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "d526188c3d4c4b69b8be93b7d45d7249"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "950db3f97627dac852aac5630e3a319e"
server_key_iv: "b536b1c24d3b0ca06183e6a2aebbff0d"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.736913 27151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:03.746994 27151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:03.749538 27151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:03.749753 27151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:03.750036 27151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:03.750391 27151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:03.750449 27151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.750486 27151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:03.750519 27151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.757086 27151 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:37705
I20260807 00:39:03.757133 27287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:37705 every 8 connection(s)
I20260807 00:39:03.757488 27151 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:39:03.762544 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27151
I20260807 00:39:03.762708 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:39:03.762976 8176 external_mini_cluster.cc:1428] Setting key bf2799d35c0df0e27880ef4924101bb4
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:03.768375 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:03.758344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:56873 (local address 127.7.252.62:41687)
0807 00:39:03.758398 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:03.758400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:03.758579 (+ 179us) server_negotiation.cc:407] Connection header received
0807 00:39:03.759180 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:03.759181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:03.759195 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:03.759248 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:03.760404 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.760987 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.762227 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.762514 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.762676 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:03.765340 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:03.765342 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:03.765342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:03.765355 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:03.766878 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:03.767330 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:03.767331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:03.767332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:03.767392 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:03.767660 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:03.767661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:03.767662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:03.767795 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:03.767872 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:03.768185 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 00:39:03.768277 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:39:03.768607 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:03.758220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41687 (local address 127.7.252.1:56873)
0807 00:39:03.758396 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:03.758443 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:03.759066 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:03.759323 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:03.759327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:03.759943 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:03.760147 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:03.760152 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.761094 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.761095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:03.762129 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:03.762132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.762750 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.762751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:03.762901 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:03.763693 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:03.763705 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:03.765201 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:03.766977 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:03.766985 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:03.766988 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:03.767228 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:03.767460 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:03.767460 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:03.767461 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:03.767588 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:03.767863 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:03.767871 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:03.768038 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 00:39:03.768150 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 00:39:03.768335 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":107,"threads_started":1}
I20260807 00:39:03.769109 27288 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41687
I20260807 00:39:03.769232 27288 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:03.769421 27288 heartbeater.cc:511] Master 127.7.252.62:41687 requested a full tablet report, sending...
I20260807 00:39:03.769982 27086 ts_manager.cc:194] Registered new tserver with Master: d526188c3d4c4b69b8be93b7d45d7249 (127.7.252.1:37705)
I20260807 00:39:03.770711 27086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:56873
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:39:03.795670 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41687
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:03.883708 27293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:03.883941 27293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:03.883968 27293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:03.885178 27293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:03.885221 27293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:03.885248 27293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:39:03.886775 27293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:03.886986 27293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:03.887179 27293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:39:03.893057 27293 server_base.cc:1034] running on GCE node
W20260807 00:39:03.893033 27298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:03.893033 27301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:03.893038 27299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:03.893649 27293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:03.893949 27293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:03.895155 27293 hybrid_clock.cc:648] HybridClock initialized: now 1786063143895145 us; error 46 us; skew 500 ppm
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:03.897992 27293 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:39:03.898561 27293 webserver.cc:460] Webserver started at http://127.7.252.2:46229/ using document root <none> and password file <none>
I20260807 00:39:03.898844 27293 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:03.898921 27293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:03.899089 27293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:03.900216 27293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "a336061413174bf2a790d9f31428bb67"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "9cb9e63df11bcd61d12cc6449c81bac9"
server_key_iv: "2f88c676d066de3be4daead789c98851"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.900605 27293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "a336061413174bf2a790d9f31428bb67"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "9cb9e63df11bcd61d12cc6449c81bac9"
server_key_iv: "2f88c676d066de3be4daead789c98851"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.902275 27293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:03.903301 27308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.903489 27293 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:39:03.903606 27293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "a336061413174bf2a790d9f31428bb67"
format_stamp: "Formatted at 2026-08-07 00:39:03 on dist-test-slave-csg5"
server_key: "9cb9e63df11bcd61d12cc6449c81bac9"
server_key_iv: "2f88c676d066de3be4daead789c98851"
server_key_version: "encryptionkey@0"
I20260807 00:39:03.903689 27293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:03.924721 27293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:03.927388 27293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:03.927609 27293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:03.927906 27293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:03.928293 27293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:03.928352 27293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.928390 27293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:03.928432 27293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:03.934943 27293 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:37887
I20260807 00:39:03.934994 27427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:37887 every 8 connection(s)
I20260807 00:39:03.935376 27293 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
Aug 07 00:39:03 dist-test-slave-csg5 krb5kdc[27037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063143, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:03.943220 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27293
I20260807 00:39:03.943360 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:39:03.943682 8176 external_mini_cluster.cc:1428] Setting key b693cc17db31e74bfb06ec6eb6ab90e3
I20260807 00:39:03.946141 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:03.936433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58447 (local address 127.7.252.62:41687)
0807 00:39:03.936507 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:03.936509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:03.936563 (+ 54us) server_negotiation.cc:407] Connection header received
0807 00:39:03.937165 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:03.937166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:03.937180 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:03.937232 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:03.938295 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.938918 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.939980 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.940244 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.940331 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:03.942874 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:03.942876 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:03.942877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:03.942885 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:03.944617 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:03.945054 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:03.945055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:03.945056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:03.945120 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:03.945415 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:03.945416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:03.945416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:03.945541 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:03.945617 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:03.945949 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 00:39:03.946039 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:39:03.946477 27430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:03.936215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41687 (local address 127.7.252.2:58447)
0807 00:39:03.936410 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:03.936471 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:03.937037 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:03.937324 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:03.937330 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:03.937941 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:03.938178 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:03.938183 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.939022 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.939023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:03.939879 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:03.939882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:03.940341 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:03.940342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:03.940478 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:03.941148 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:03.941158 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:03.942760 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:03.944715 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:03.944723 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:03.944730 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:03.944970 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:03.945205 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:03.945206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:03.945207 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:03.945334 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:03.945620 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:03.945628 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:03.945805 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 00:39:03.945925 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 00:39:03.946106 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":77,"threads_started":1}
I20260807 00:39:03.947049 27428 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41687
I20260807 00:39:03.947144 27428 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:03.947445 27428 heartbeater.cc:511] Master 127.7.252.62:41687 requested a full tablet report, sending...
I20260807 00:39:03.947904 27086 ts_manager.cc:194] Registered new tserver with Master: a336061413174bf2a790d9f31428bb67 (127.7.252.2:37887)
I20260807 00:39:03.948453 27086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:58447
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:39:03.980566 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41687
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:04.077044 27433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:04.077294 27433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:04.077324 27433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:04.078753 27433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:04.078806 27433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:04.078838 27433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:39:04.080555 27433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:41687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:04.080817 27433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:04.081039 27433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:04.086915 27438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.086922 27441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.086933 27439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:04.087466 27433 server_base.cc:1034] running on GCE node
I20260807 00:39:04.087680 27433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:04.087956 27433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:04.089136 27433 hybrid_clock.cc:648] HybridClock initialized: now 1786063144089121 us; error 30 us; skew 500 ppm
Aug 07 00:39:04 dist-test-slave-csg5 krb5kdc[27037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063144, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:04.092164 27433 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:39:04.092732 27433 webserver.cc:460] Webserver started at http://127.7.252.3:35343/ using document root <none> and password file <none>
I20260807 00:39:04.093012 27433 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:04.093088 27433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:04.093259 27433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:04.094584 27433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "75051de27f9c4ea388d0df880e328475"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "7ebf8e8f2c89dbff6a946aa22176b120"
server_key_iv: "9db7d708c2572526b7e1751d645d3f7c"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.095032 27433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "75051de27f9c4ea388d0df880e328475"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "7ebf8e8f2c89dbff6a946aa22176b120"
server_key_iv: "9db7d708c2572526b7e1751d645d3f7c"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.096530 27433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:04.097530 27449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.097765 27433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:04.097879 27433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "75051de27f9c4ea388d0df880e328475"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "7ebf8e8f2c89dbff6a946aa22176b120"
server_key_iv: "9db7d708c2572526b7e1751d645d3f7c"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.097958 27433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:04.113158 27433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:04.115716 27433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:04.115909 27433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:04.116222 27433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:04.116597 27433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:04.116657 27433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.116690 27433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:04.116719 27433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.123749 27433 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:41285
I20260807 00:39:04.123845 27567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:41285 every 8 connection(s)
I20260807 00:39:04.124213 27433 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:39:04.127573 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27433
I20260807 00:39:04.127699 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:39:04.127890 8176 external_mini_cluster.cc:1428] Setting key 5495a4a506a3f1d540be40880b5c9b0a
Aug 07 00:39:04 dist-test-slave-csg5 krb5kdc[27037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063144, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:04.135921 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.125112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:59141 (local address 127.7.252.62:41687)
0807 00:39:04.125286 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.125289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.125474 (+ 185us) server_negotiation.cc:407] Connection header received
0807 00:39:04.126093 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.126094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.126108 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.126176 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:04.127292 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.128164 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.129522 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.129762 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.129864 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.132569 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:04.132570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:04.132571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:04.132589 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:04.134267 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:04.134835 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:04.134836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:04.134836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:04.134901 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:04.135171 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:04.135172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:04.135172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:04.135315 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:04.135398 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.135714 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.135823 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260807 00:39:04.136166 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.125012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41687 (local address 127.7.252.3:59141)
0807 00:39:04.125318 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.125374 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.125961 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.126274 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.126278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.126949 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:04.127171 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.127176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.128295 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.128297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.129396 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.129399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.129879 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.129880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.130028 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.130646 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:04.130684 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:04.132435 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:04.134401 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:04.134413 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:04.134416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:04.134740 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:04.134970 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:04.134971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:04.134971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:04.135092 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:04.135388 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:04.135395 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:04.135552 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.135689 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.135870 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":135,"threads_started":1}
I20260807 00:39:04.136740 27568 heartbeater.cc:347] Connected to a master server at 127.7.252.62:41687
I20260807 00:39:04.136878 27568 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:04.137089 27568 heartbeater.cc:511] Master 127.7.252.62:41687 requested a full tablet report, sending...
I20260807 00:39:04.137770 27086 ts_manager.cc:194] Registered new tserver with Master: 75051de27f9c4ea388d0df880e328475 (127.7.252.3:41285)
I20260807 00:39:04.138198 27086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:59141
I20260807 00:39:04.140409 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:39:04.150183 27128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.142059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51916 (local address 127.7.252.62:41687)
0807 00:39:04.142169 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.142172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.142375 (+ 203us) server_negotiation.cc:407] Connection header received
0807 00:39:04.142492 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.142493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.142504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.142562 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:04.143271 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.143837 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.144660 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.144898 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.144998 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.146899 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:04.146901 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:04.146901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:04.146910 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:04.148745 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:04.149229 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:04.149230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:04.149230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:04.149297 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:04.149533 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:04.149534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:04.149534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:04.149701 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:04.149830 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.149982 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.150052 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 00:39:04.152395 27086 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:39:04.154163 27086 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:39:04.162168 27585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.157610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33840 (local address 127.7.252.2:37887)
0807 00:39:04.157788 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.157792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.158110 (+ 318us) server_negotiation.cc:407] Connection header received
0807 00:39:04.158158 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.158160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.158174 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.158245 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:04.158530 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.159669 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.160839 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.161645 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.161725 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.161788 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.162001 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.162062 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
I20260807 00:39:04.162185 27581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.157100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:41285 (local address 127.0.0.1:45132)
0807 00:39:04.157871 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.157880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.157933 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.158134 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.158137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.158139 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:04.158221 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.158224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.159290 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.159291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.160882 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.160886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.161896 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.161897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.161967 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.161972 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.162032 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.162095 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":92,"threads_started":1}
I20260807 00:39:04.162300 27582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.157213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45132 (local address 127.7.252.3:41285)
0807 00:39:04.157419 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.157425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.157964 (+ 539us) server_negotiation.cc:407] Connection header received
0807 00:39:04.158013 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.158016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.158033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.158120 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:04.158286 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.159184 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.160991 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.161826 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.161891 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.161941 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.162162 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.162208 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":94,"threads_started":1}
I20260807 00:39:04.162206 27584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.157094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:37705 (local address 127.0.0.1:43944)
0807 00:39:04.157562 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.157606 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.157699 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.158326 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.158327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.158330 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:04.158390 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.158391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.159792 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.159793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.160915 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.160916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.161755 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.161755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.161878 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.161897 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.161971 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.162072 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":40,"thread_start_us":78,"threads_started":1}
I20260807 00:39:04.162889 27580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.157350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:37887 (local address 127.0.0.1:33840)
0807 00:39:04.158003 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.158011 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.158051 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.158328 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.158329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.158331 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:04.158394 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.158395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.159824 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.159825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.160734 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.160737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.161753 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.161754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.161878 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.161897 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.161971 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.162072 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":40,"thread_start_us":87,"threads_started":1}
I20260807 00:39:04.162961 27583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.157329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43944 (local address 127.7.252.1:37705)
0807 00:39:04.157504 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.157509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.157678 (+ 169us) server_negotiation.cc:407] Connection header received
0807 00:39:04.157845 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.157848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.157867 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.157957 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:04.158480 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.159669 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.161007 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.161643 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.162112 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.162782 (+ 670us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.162817 (+ 35us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.162865 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260807 00:39:04.163275 27500 tablet_service.cc:1467] Processing CreateTablet for tablet 1a3809704d184bb9880f8f4eca4cd0bf (DEFAULT_TABLE table=test-table [id=5ec5e562538447c7b8e50d3ea7e38cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:04.163537 27219 tablet_service.cc:1467] Processing CreateTablet for tablet 1a3809704d184bb9880f8f4eca4cd0bf (DEFAULT_TABLE table=test-table [id=5ec5e562538447c7b8e50d3ea7e38cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:04.163566 27359 tablet_service.cc:1467] Processing CreateTablet for tablet 1a3809704d184bb9880f8f4eca4cd0bf (DEFAULT_TABLE table=test-table [id=5ec5e562538447c7b8e50d3ea7e38cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:04.163672 27500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a3809704d184bb9880f8f4eca4cd0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:04.163800 27219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a3809704d184bb9880f8f4eca4cd0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:04.163919 27359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a3809704d184bb9880f8f4eca4cd0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:04.166778 27586 tablet_bootstrap.cc:492] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: Bootstrap starting.
I20260807 00:39:04.167155 27587 tablet_bootstrap.cc:492] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Bootstrap starting.
I20260807 00:39:04.167620 27586 tablet_bootstrap.cc:654] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:04.167824 27587 tablet_bootstrap.cc:654] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:04.168329 27586 log.cc:824] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:04.168473 27587 log.cc:824] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:04.168733 27588 tablet_bootstrap.cc:492] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Bootstrap starting.
I20260807 00:39:04.169373 27587 tablet_bootstrap.cc:492] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: No bootstrap required, opened a new log
I20260807 00:39:04.169420 27586 tablet_bootstrap.cc:492] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: No bootstrap required, opened a new log
I20260807 00:39:04.169499 27587 ts_tablet_manager.cc:1397] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:04.169519 27586 ts_tablet_manager.cc:1397] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:04.169613 27588 tablet_bootstrap.cc:654] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:04.170214 27588 log.cc:824] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:04.171079 27588 tablet_bootstrap.cc:492] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: No bootstrap required, opened a new log
I20260807 00:39:04.171170 27588 ts_tablet_manager.cc:1397] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:04.171566 27586 raft_consensus.cc:348] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.171762 27586 raft_consensus.cc:374] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:04.171813 27586 raft_consensus.cc:729] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d526188c3d4c4b69b8be93b7d45d7249, State: Initialized, Role: FOLLOWER
I20260807 00:39:04.171690 27587 raft_consensus.cc:348] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.171859 27587 raft_consensus.cc:374] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:04.171902 27587 raft_consensus.cc:729] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75051de27f9c4ea388d0df880e328475, State: Initialized, Role: FOLLOWER
I20260807 00:39:04.171972 27586 consensus_queue.cc:260] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.172046 27587 consensus_queue.cc:260] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.172333 27587 ts_tablet_manager.cc:1428] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:04.172366 27568 heartbeater.cc:503] Master 127.7.252.62:41687 was elected leader, sending a full tablet report...
I20260807 00:39:04.172631 27586 ts_tablet_manager.cc:1428] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:04.172814 27288 heartbeater.cc:503] Master 127.7.252.62:41687 was elected leader, sending a full tablet report...
I20260807 00:39:04.173277 27588 raft_consensus.cc:348] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.173487 27588 raft_consensus.cc:374] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:04.173548 27588 raft_consensus.cc:729] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a336061413174bf2a790d9f31428bb67, State: Initialized, Role: FOLLOWER
I20260807 00:39:04.173671 27588 consensus_queue.cc:260] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.173979 27588 ts_tablet_manager.cc:1428] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:04.174016 27428 heartbeater.cc:503] Master 127.7.252.62:41687 was elected leader, sending a full tablet report...
W20260807 00:39:04.186000 27429 tablet.cc:2369] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:39:04.258493 27289 tablet.cc:2369] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:04.284586 27593 raft_consensus.cc:482] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:39:04.284775 27593 raft_consensus.cc:504] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.285204 27593 leader_election.cc:288] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d526188c3d4c4b69b8be93b7d45d7249 (127.7.252.1:37705), a336061413174bf2a790d9f31428bb67 (127.7.252.2:37887)
I20260807 00:39:04.288475 27583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.285577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:48839 (local address 127.7.252.1:37705)
0807 00:39:04.285648 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.285651 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.285681 (+ 30us) server_negotiation.cc:407] Connection header received
0807 00:39:04.285828 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.285829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.285844 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.285910 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:04.286146 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.286765 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.287707 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.288089 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.288144 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.288153 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.288346 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.288402 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:39:04.288475 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.285522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:37705 (local address 127.7.252.3:48839)
0807 00:39:04.285587 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.285616 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.285676 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.285971 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.285972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.285975 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:04.286055 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.286058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.286848 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.286849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.287613 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.287615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.288175 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.288176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.288266 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.288270 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.288326 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.288361 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":5}
I20260807 00:39:04.288551 27585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.285720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:54971 (local address 127.7.252.2:37887)
0807 00:39:04.285772 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.285775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.285949 (+ 174us) server_negotiation.cc:407] Connection header received
0807 00:39:04.285981 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.285982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.285995 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.286067 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:04.286249 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.286778 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.287769 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.288172 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.288243 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.288254 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.288436 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.288479 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:39:04.288563 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.285660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:37887 (local address 127.7.252.3:54971)
0807 00:39:04.285866 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.285876 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.285932 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.286074 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.286075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.286077 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:04.286170 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.286171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.286873 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.286874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.287639 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.287641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.288259 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.288260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.288339 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.288344 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.288401 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.288437 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":127,"threads_started":1}
I20260807 00:39:04.288897 27380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3809704d184bb9880f8f4eca4cd0bf" candidate_uuid: "75051de27f9c4ea388d0df880e328475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a336061413174bf2a790d9f31428bb67" is_pre_election: true
I20260807 00:39:04.289026 27239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3809704d184bb9880f8f4eca4cd0bf" candidate_uuid: "75051de27f9c4ea388d0df880e328475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d526188c3d4c4b69b8be93b7d45d7249" is_pre_election: true
I20260807 00:39:04.289083 27380 raft_consensus.cc:2454] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75051de27f9c4ea388d0df880e328475 in term 0.
I20260807 00:39:04.289170 27239 raft_consensus.cc:2454] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75051de27f9c4ea388d0df880e328475 in term 0.
I20260807 00:39:04.289309 27451 leader_election.cc:302] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75051de27f9c4ea388d0df880e328475, a336061413174bf2a790d9f31428bb67; no voters:
I20260807 00:39:04.289474 27593 raft_consensus.cc:2781] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:39:04.289543 27593 raft_consensus.cc:482] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:39:04.289561 27593 raft_consensus.cc:3037] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:04.290330 27593 raft_consensus.cc:504] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.290478 27593 leader_election.cc:288] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [CANDIDATE]: Term 1 election: Requested vote from peers d526188c3d4c4b69b8be93b7d45d7249 (127.7.252.1:37705), a336061413174bf2a790d9f31428bb67 (127.7.252.2:37887)
I20260807 00:39:04.290715 27380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3809704d184bb9880f8f4eca4cd0bf" candidate_uuid: "75051de27f9c4ea388d0df880e328475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a336061413174bf2a790d9f31428bb67"
I20260807 00:39:04.290671 27239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3809704d184bb9880f8f4eca4cd0bf" candidate_uuid: "75051de27f9c4ea388d0df880e328475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d526188c3d4c4b69b8be93b7d45d7249"
I20260807 00:39:04.290799 27380 raft_consensus.cc:3037] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:04.290828 27239 raft_consensus.cc:3037] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:04.291597 27380 raft_consensus.cc:2454] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75051de27f9c4ea388d0df880e328475 in term 1.
I20260807 00:39:04.291720 27239 raft_consensus.cc:2454] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75051de27f9c4ea388d0df880e328475 in term 1.
I20260807 00:39:04.291771 27451 leader_election.cc:302] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75051de27f9c4ea388d0df880e328475, a336061413174bf2a790d9f31428bb67; no voters:
I20260807 00:39:04.291899 27593 raft_consensus.cc:2781] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:04.292088 27593 raft_consensus.cc:686] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 1 LEADER]: Becoming Leader. State: Replica: 75051de27f9c4ea388d0df880e328475, State: Running, Role: LEADER
I20260807 00:39:04.292199 27593 consensus_queue.cc:237] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } }
I20260807 00:39:04.293125 27086 catalog_manager.cc:5495] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75051de27f9c4ea388d0df880e328475 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "75051de27f9c4ea388d0df880e328475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75051de27f9c4ea388d0df880e328475" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 41285 } health_report { overall_health: HEALTHY } } }
I20260807 00:39:04.310220 27582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.307551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45146 (local address 127.7.252.3:41285)
0807 00:39:04.307621 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.307623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.307633 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:04.307812 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.307813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.307834 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.307945 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:04.308063 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.308621 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.309398 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.309592 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.309709 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.309865 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:04.309965 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:04.310079 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.310110 (+ 31us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.310118 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 00:39:04.312565 27239 raft_consensus.cc:1261] T 1a3809704d184bb9880f8f4eca4cd0bf P d526188c3d4c4b69b8be93b7d45d7249 [term 1 FOLLOWER]: Refusing update from remote peer 75051de27f9c4ea388d0df880e328475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:04.312544 27380 raft_consensus.cc:1261] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 1 FOLLOWER]: Refusing update from remote peer 75051de27f9c4ea388d0df880e328475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:04.312960 27593 consensus_queue.cc:1035] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a336061413174bf2a790d9f31428bb67" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:04.313138 27596 consensus_queue.cc:1035] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d526188c3d4c4b69b8be93b7d45d7249" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:04.316201 27599 mvcc.cc:205] Tried to move back new op lower bound from 7315714639100207104 to 7315714639021608960. Current Snapshot: MvccSnapshot[applied={T|T < 7315714639100207104}]
I20260807 00:39:04.317660 27600 mvcc.cc:205] Tried to move back new op lower bound from 7315714639100207104 to 7315714639021608960. Current Snapshot: MvccSnapshot[applied={T|T < 7315714639100207104 or (T in {7315714639100207104})}]
I20260807 00:39:04.318904 27086 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:04.319028 27086 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:04.319934 27086 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 585ad02e44ba4ff2b3591a92888d3c0d: Sending DeleteTablet for 3 replicas of tablet 1a3809704d184bb9880f8f4eca4cd0bf
I20260807 00:39:04.320329 27219 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a3809704d184bb9880f8f4eca4cd0bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:04 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:43944
I20260807 00:39:04.320309 27500 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a3809704d184bb9880f8f4eca4cd0bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:04 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:45132
I20260807 00:39:04.320665 27359 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a3809704d184bb9880f8f4eca4cd0bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:04 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:33840
I20260807 00:39:04.320996 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27151
I20260807 00:39:04.322856 27611 tablet_replica.cc:330] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: stopping tablet replica
I20260807 00:39:04.323014 27611 raft_consensus.cc:2229] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:04.323194 27611 raft_consensus.cc:2258] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:04.323719 27611 ts_tablet_manager.cc:1905] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:04.325701 27611 ts_tablet_manager.cc:1918] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:04.325855 27611 log.cc:1196] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/1a3809704d184bb9880f8f4eca4cd0bf
I20260807 00:39:04.326191 27611 ts_tablet_manager.cc:1939] T 1a3809704d184bb9880f8f4eca4cd0bf P a336061413174bf2a790d9f31428bb67: Deleting consensus metadata
I20260807 00:39:04.326774 27068 catalog_manager.cc:4841] TS a336061413174bf2a790d9f31428bb67 (127.7.252.2:37887): tablet 1a3809704d184bb9880f8f4eca4cd0bf (table test-table [id=5ec5e562538447c7b8e50d3ea7e38cb8]) successfully deleted
W20260807 00:39:04.329608 27068 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:37705 (error 108)
I20260807 00:39:04.330178 27610 tablet_replica.cc:330] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: stopping tablet replica
I20260807 00:39:04.330329 27580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.330155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:37705 (local address 127.0.0.1:43948)
0807 00:39:04.330238 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.330287 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:37705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 00:39:04.330443 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27293
I20260807 00:39:04.330482 27610 raft_consensus.cc:2229] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:39:04.330621 27610 raft_consensus.cc:2258] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 00:39:04.332772 27068 catalog_manager.cc:4584] TS d526188c3d4c4b69b8be93b7d45d7249 (127.7.252.1:37705): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a3809704d184bb9880f8f4eca4cd0bf: Network error: Client connection negotiation failed: client connection to 127.7.252.1:37705: connect: Connection refused (error 111)
I20260807 00:39:04.333372 27610 ts_tablet_manager.cc:1905] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:04.335961 27610 ts_tablet_manager.cc:1918] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:04.336081 27610 log.cc:1196] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/1a3809704d184bb9880f8f4eca4cd0bf
I20260807 00:39:04.336400 27610 ts_tablet_manager.cc:1939] T 1a3809704d184bb9880f8f4eca4cd0bf P 75051de27f9c4ea388d0df880e328475: Deleting consensus metadata
I20260807 00:39:04.336956 27071 catalog_manager.cc:4841] TS 75051de27f9c4ea388d0df880e328475 (127.7.252.3:41285): tablet 1a3809704d184bb9880f8f4eca4cd0bf (table test-table [id=5ec5e562538447c7b8e50d3ea7e38cb8]) successfully deleted
I20260807 00:39:04.340633 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27433
I20260807 00:39:04.346979 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27051
2026-08-07T00:39:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2233 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T00:39:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:04Z Disabled control of system clock
I20260807 00:39:04.380729 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:33987
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:33987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:04.467661 27617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:04.467940 27617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:04.467965 27617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:04.469306 27617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:04.469368 27617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:04.469381 27617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:04.469395 27617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:04.469408 27617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:04.471069 27617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:33987
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:33987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:04.471355 27617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:04.471699 27617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:04.477429 27622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.477393 27625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.477506 27623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:04.478168 27617 server_base.cc:1034] running on GCE node
I20260807 00:39:04.478528 27617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:04.479055 27617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:04.480350 27617 hybrid_clock.cc:648] HybridClock initialized: now 1786063144480295 us; error 67 us; skew 500 ppm
I20260807 00:39:04.482354 27617 webserver.cc:460] Webserver started at http://127.7.252.62:43801/ using document root <none> and password file <none>
I20260807 00:39:04.482757 27617 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:04.482832 27617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:04.483002 27617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:04.484251 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "174d43f20f874b59b5ffff452ba95e46"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "6383b4336a106e1f87eac1ae1827b13f"
server_key_iv: "ecc14d265dce6c42889fc9e5cf79bff1"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.484678 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "174d43f20f874b59b5ffff452ba95e46"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "6383b4336a106e1f87eac1ae1827b13f"
server_key_iv: "ecc14d265dce6c42889fc9e5cf79bff1"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.486765 27617 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 00:39:04.487937 27631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.488286 27617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:04.488448 27617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "174d43f20f874b59b5ffff452ba95e46"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "6383b4336a106e1f87eac1ae1827b13f"
server_key_iv: "ecc14d265dce6c42889fc9e5cf79bff1"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.488557 27617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:04.503105 27617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:04.503499 27617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:04.503667 27617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:04.508116 27617 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:33987
I20260807 00:39:04.508402 27684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:33987 every 8 connection(s)
I20260807 00:39:04.508600 27617 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:04.509707 27685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:04.512351 27685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46: Bootstrap starting.
I20260807 00:39:04.512985 27685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:04.513262 27685 log.cc:824] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:04.514060 27685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46: No bootstrap required, opened a new log
I20260807 00:39:04.515936 27685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174d43f20f874b59b5ffff452ba95e46" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33987 } }
I20260807 00:39:04.516109 27685 raft_consensus.cc:374] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:04.516136 27685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 174d43f20f874b59b5ffff452ba95e46, State: Initialized, Role: FOLLOWER
I20260807 00:39:04.516341 27685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174d43f20f874b59b5ffff452ba95e46" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33987 } }
I20260807 00:39:04.516448 27685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:04.516475 27685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:04.516510 27685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:04.516700 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27617
I20260807 00:39:04.516820 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:04.517048 8176 external_mini_cluster.cc:1428] Setting key 49a99e19403a4435adc0eb84320d9b15
I20260807 00:39:04.517316 27685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174d43f20f874b59b5ffff452ba95e46" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33987 } }
I20260807 00:39:04.517457 27685 leader_election.cc:302] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 174d43f20f874b59b5ffff452ba95e46; no voters:
I20260807 00:39:04.517688 27685 leader_election.cc:288] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:04.517733 27689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:04.517891 27689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [term 1 LEADER]: Becoming Leader. State: Replica: 174d43f20f874b59b5ffff452ba95e46, State: Running, Role: LEADER
I20260807 00:39:04.517992 27689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174d43f20f874b59b5ffff452ba95e46" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33987 } }
I20260807 00:39:04.518033 27685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:04.518522 27691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 174d43f20f874b59b5ffff452ba95e46. Latest consensus state: current_term: 1 leader_uuid: "174d43f20f874b59b5ffff452ba95e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174d43f20f874b59b5ffff452ba95e46" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33987 } } }
I20260807 00:39:04.518627 27691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:04.519121 27697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:04.519707 27697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:04.520002 27692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "174d43f20f874b59b5ffff452ba95e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174d43f20f874b59b5ffff452ba95e46" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 33987 } } }
I20260807 00:39:04.520074 27692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:04.521523 27697 catalog_manager.cc:1347] Generated new cluster ID: a9d0f3ee03e7438796fa93b6f40469d8
I20260807 00:39:04.521584 27697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:04.524147 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.517591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.7.252.62:33987)
0807 00:39:04.517876 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.517887 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.517926 (+ 39us) server_negotiation.cc:407] Connection header received
0807 00:39:04.518177 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.518186 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.518285 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.518417 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:04.519204 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.520704 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.521892 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.522364 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.522510 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.523372 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:04.523376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:04.523377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:04.523578 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:04.523614 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:04.523627 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:04.523714 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.523820 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.523912 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":103,"threads_started":1}
I20260807 00:39:04.542689 27697 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:04.543512 27697 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:04.551945 27697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46: Generated new TSK 0
I20260807 00:39:04.552222 27697 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:04.553938 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33987
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:04.651997 27710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:04.652225 27710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:04.652251 27710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:04.653518 27710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:04.653569 27710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:04.653597 27710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:39:04.655069 27710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:04.655349 27710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:04.655676 27710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:04.661159 27715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.661170 27718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.661317 27716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:04.661527 27710 server_base.cc:1034] running on GCE node
I20260807 00:39:04.661747 27710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:04.662045 27710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:04.663246 27710 hybrid_clock.cc:648] HybridClock initialized: now 1786063144663234 us; error 41 us; skew 500 ppm
I20260807 00:39:04.664793 27710 webserver.cc:460] Webserver started at http://127.7.252.1:44917/ using document root <none> and password file <none>
I20260807 00:39:04.665072 27710 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:04.665122 27710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:04.665297 27710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:04.666427 27710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "890a04c9ca564d6dbcd8f15afb857414"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "9631fb5535b36fe64c6d27db30c9526b"
server_key_iv: "b347027b936a200c7542709981c569fb"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.666836 27710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "890a04c9ca564d6dbcd8f15afb857414"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "9631fb5535b36fe64c6d27db30c9526b"
server_key_iv: "b347027b936a200c7542709981c569fb"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.668231 27710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:04.669050 27724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.669211 27710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:04.669320 27710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "890a04c9ca564d6dbcd8f15afb857414"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "9631fb5535b36fe64c6d27db30c9526b"
server_key_iv: "b347027b936a200c7542709981c569fb"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.669404 27710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:04.681048 27710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:04.681432 27710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:04.681586 27710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:04.681897 27710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:04.682298 27710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:04.682366 27710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.682413 27710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:04.682442 27710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.689091 27710 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:45329
I20260807 00:39:04.689152 27845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:45329 every 8 connection(s)
I20260807 00:39:04.689563 27710 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:39:04.691301 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27710
I20260807 00:39:04.691447 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:39:04.691694 8176 external_mini_cluster.cc:1428] Setting key bc1bd17f1f9945cc66470df11ae37841
I20260807 00:39:04.693065 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33987
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 00:39:04.696552 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.690367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:38397 (local address 127.7.252.62:33987)
0807 00:39:04.690456 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.690459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.690718 (+ 259us) server_negotiation.cc:407] Connection header received
0807 00:39:04.691353 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.691355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.691375 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.691475 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:04.692525 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.693405 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.694903 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.695133 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.695235 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.696167 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:04.696168 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:04.696169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:04.696175 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:04.696198 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:04.696203 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:04.696290 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.696411 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.696455 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 00:39:04.696813 27848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.690338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33987 (local address 127.7.252.1:38397)
0807 00:39:04.690566 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.690602 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.691215 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.691634 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.691638 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.691646 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:04.692408 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.692415 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.693531 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.693532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.694618 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.694621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.695250 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.695252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.695425 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.696001 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:04.696001 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:04.696034 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:04.696060 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:04.696296 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:04.696303 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:04.696308 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.696413 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.696536 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":116,"threads_started":1}
I20260807 00:39:04.697433 27846 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33987
I20260807 00:39:04.697554 27846 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:04.697786 27846 heartbeater.cc:511] Master 127.7.252.62:33987 requested a full tablet report, sending...
I20260807 00:39:04.698465 27649 ts_manager.cc:194] Registered new tserver with Master: 890a04c9ca564d6dbcd8f15afb857414 (127.7.252.1:45329)
I20260807 00:39:04.699235 27649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.1:38397
W20260807 00:39:04.782318 27849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:04.782547 27849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:04.782572 27849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:04.783826 27849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:04.783876 27849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:04.783905 27849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:39:04.785339 27849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:04.785612 27849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:04.785949 27849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:04.791488 27857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.791479 27855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.791479 27854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:04.792012 27849 server_base.cc:1034] running on GCE node
I20260807 00:39:04.792338 27849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:04.792627 27849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:04.793803 27849 hybrid_clock.cc:648] HybridClock initialized: now 1786063144793774 us; error 44 us; skew 500 ppm
I20260807 00:39:04.795424 27849 webserver.cc:460] Webserver started at http://127.7.252.2:44977/ using document root <none> and password file <none>
I20260807 00:39:04.795719 27849 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:04.795774 27849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:04.795918 27849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:04.797086 27849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "a44d46deaa7242878d0bb80d45b09a70"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "fd5c077b7f1dfd8cd467123f3d97d457"
server_key_iv: "30bbade45e8ecd1bd76495839f6b6048"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.797406 27849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "a44d46deaa7242878d0bb80d45b09a70"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "fd5c077b7f1dfd8cd467123f3d97d457"
server_key_iv: "30bbade45e8ecd1bd76495839f6b6048"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.798971 27849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260807 00:39:04.799988 27863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.800189 27849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:04.800278 27849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "a44d46deaa7242878d0bb80d45b09a70"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "fd5c077b7f1dfd8cd467123f3d97d457"
server_key_iv: "30bbade45e8ecd1bd76495839f6b6048"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.800343 27849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:04.833117 27849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:04.833429 27849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:04.833539 27849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:04.833742 27849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:04.834033 27849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:04.834061 27849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.834084 27849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:04.834096 27849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.840689 27849 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:33943
I20260807 00:39:04.840826 27987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:33943 every 8 connection(s)
I20260807 00:39:04.841272 27849 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:39:04.847218 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.842228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:41825 (local address 127.7.252.62:33987)
0807 00:39:04.842300 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.842302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.842639 (+ 337us) server_negotiation.cc:407] Connection header received
0807 00:39:04.843314 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.843316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.843329 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.843388 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:04.844140 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.844654 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.845681 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.845908 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.845993 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.846847 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:04.846849 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:04.846850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:04.846855 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:04.846873 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:04.846877 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:04.846994 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.847094 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.847129 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:39:04.847470 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.842203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33987 (local address 127.7.252.2:41825)
0807 00:39:04.842495 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.842532 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.843169 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.843487 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.843491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.843499 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:04.844018 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.844022 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.844755 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.844756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.845579 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.845581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.846002 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.846004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.846141 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.846692 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:04.846692 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:04.846724 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:04.846749 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:04.846994 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:04.847002 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:04.847006 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.847097 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.847214 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":95,"threads_started":1}
I20260807 00:39:04.847955 27988 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33987
I20260807 00:39:04.848083 27988 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:04.848280 27988 heartbeater.cc:511] Master 127.7.252.62:33987 requested a full tablet report, sending...
I20260807 00:39:04.848764 27649 ts_manager.cc:194] Registered new tserver with Master: a44d46deaa7242878d0bb80d45b09a70 (127.7.252.2:33943)
I20260807 00:39:04.849200 27649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.2:41825
I20260807 00:39:04.850544 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27849
I20260807 00:39:04.850637 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:39:04.850924 8176 external_mini_cluster.cc:1428] Setting key d7762d515537d7a6fe4d381517bdfe7d
I20260807 00:39:04.851866 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33987
--builtin_ntp_servers=127.7.252.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:04.944306 27991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:04.944542 27991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:04.944567 27991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:04.945825 27991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:04.945876 27991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:04.945904 27991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:39:04.947436 27991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:33987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:04.947698 27991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:04.948048 27991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:04.953929 27999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.954001 27996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:04.953930 27997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:04.954182 27991 server_base.cc:1034] running on GCE node
I20260807 00:39:04.954567 27991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:04.954887 27991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:04.956085 27991 hybrid_clock.cc:648] HybridClock initialized: now 1786063144956078 us; error 40 us; skew 500 ppm
I20260807 00:39:04.957798 27991 webserver.cc:460] Webserver started at http://127.7.252.3:34961/ using document root <none> and password file <none>
I20260807 00:39:04.958084 27991 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:04.958163 27991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:04.958333 27991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:04.959635 27991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "942a91b79a4a4773937c5e90b03bdc10"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "44800393947ba65f1c9fed08dabcad1e"
server_key_iv: "39c5c40743e72f86654b4ed49ba69e65"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.960043 27991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "942a91b79a4a4773937c5e90b03bdc10"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "44800393947ba65f1c9fed08dabcad1e"
server_key_iv: "39c5c40743e72f86654b4ed49ba69e65"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.961555 27991 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:39:04.962604 28005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.962901 27991 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:04.963027 27991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "942a91b79a4a4773937c5e90b03bdc10"
format_stamp: "Formatted at 2026-08-07 00:39:04 on dist-test-slave-csg5"
server_key: "44800393947ba65f1c9fed08dabcad1e"
server_key_iv: "39c5c40743e72f86654b4ed49ba69e65"
server_key_version: "encryptionkey@0"
I20260807 00:39:04.963122 27991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:04.979864 27991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:04.980270 27991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:04.980464 27991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:04.980778 27991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:04.981182 27991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:04.981252 27991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.981299 27991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:04.981333 27991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:04.988562 27991 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:45831
I20260807 00:39:04.988646 28131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:45831 every 8 connection(s)
I20260807 00:39:04.988999 27991 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:39:04.995580 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.989900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:60637 (local address 127.7.252.62:33987)
0807 00:39:04.989986 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:04.989988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:04.990265 (+ 277us) server_negotiation.cc:407] Connection header received
0807 00:39:04.990786 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:04.990788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:04.990809 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:04.990878 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:04.991888 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.992623 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.993818 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.994011 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.994077 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.995265 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:04.995266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:04.995267 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:04.995272 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:04.995289 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:04.995293 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:04.995347 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:04.995475 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 00:39:04.995507 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 00:39:04.995775 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:04.989804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:33987 (local address 127.7.252.3:60637)
0807 00:39:04.990055 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:04.990100 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:04.990616 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:04.991013 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:04.991017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:04.991027 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:04.991754 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.991761 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.992735 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.992736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.993681 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:04.993684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:04.994113 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:04.994114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:04.994247 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:04.995010 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:04.995011 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:04.995044 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:04.995072 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:04.995366 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:04.995370 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:04.995373 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:04.995437 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 00:39:04.995534 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":131,"threads_started":1}
I20260807 00:39:04.996539 28132 heartbeater.cc:347] Connected to a master server at 127.7.252.62:33987
I20260807 00:39:04.996690 28132 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:04.996945 28132 heartbeater.cc:511] Master 127.7.252.62:33987 requested a full tablet report, sending...
I20260807 00:39:04.997447 27649 ts_manager.cc:194] Registered new tserver with Master: 942a91b79a4a4773937c5e90b03bdc10 (127.7.252.3:45831)
I20260807 00:39:04.997880 27649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.3:60637
I20260807 00:39:04.998919 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 27991
I20260807 00:39:04.999042 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:39:04.999212 8176 external_mini_cluster.cc:1428] Setting key 6eaa29b9be518c7536b5c722f0968734
I20260807 00:39:05.000474 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:39:05.005825 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.002156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47572 (local address 127.7.252.62:33987)
0807 00:39:05.002248 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.002251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.002387 (+ 136us) server_negotiation.cc:407] Connection header received
0807 00:39:05.002505 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.002506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.002526 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.002603 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:05.002854 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.003364 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.004194 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.004399 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.004478 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.005414 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:05.005416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:05.005416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:05.005424 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:05.005446 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:05.005451 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:05.005558 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.005653 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.005666 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 00:39:05.008039 27649 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:39:05.009676 27649 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:39:05.016935 28142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.012650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:45831 (local address 127.0.0.1:45568)
0807 00:39:05.013123 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.013133 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:05.013176 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:05.013486 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:05.013487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:05.013489 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:05.013525 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.013526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.014411 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.014412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.015890 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.015892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.016609 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.016610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.016694 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.016708 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 00:39:05.016796 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 00:39:05.016859 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":78,"thread_start_us":94,"threads_started":1}
I20260807 00:39:05.016947 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.012795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.7.252.3:45831)
0807 00:39:05.013259 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.013263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.013275 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:39:05.013330 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.013332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.013347 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.013421 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:05.013597 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.014318 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.015986 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.016511 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.016609 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.016711 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.016802 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.016844 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":98,"threads_started":1}
I20260807 00:39:05.017556 28146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.012445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:33943 (local address 127.0.0.1:39498)
0807 00:39:05.012885 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.012942 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:05.013049 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:05.013332 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:05.013333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:05.013335 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:05.013408 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.013410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.014498 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.014499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.015870 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.015873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.016977 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.016979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.017049 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.017053 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:05.017422 (+ 369us) client_negotiation.cc:240] Negotiation successful
0807 00:39:05.017475 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":51,"thread_start_us":56,"threads_started":1}
I20260807 00:39:05.017611 28144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.012568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39498 (local address 127.7.252.2:33943)
0807 00:39:05.012784 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.012790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.013014 (+ 224us) server_negotiation.cc:407] Connection header received
0807 00:39:05.013156 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.013158 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.013175 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.013230 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:05.013506 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.014417 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.015972 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.016763 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.016851 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.016939 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.017465 (+ 526us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.017516 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":104,"threads_started":1}
I20260807 00:39:05.017946 28059 tablet_service.cc:1467] Processing CreateTablet for tablet 2147cd30b7794e63a3fc31be5ea94015 (DEFAULT_TABLE table=test-table [id=998fa585e6a049508f354fe045233f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:05.018421 28143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.012422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45329 (local address 127.0.0.1:58056)
0807 00:39:05.012857 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.012911 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:05.013001 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:05.013312 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:05.013315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:05.013318 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:05.013400 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.013402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.015739 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.015741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.016949 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.016952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.018169 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.018170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.018233 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.018237 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:05.018302 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 00:39:05.018347 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":74,"threads_started":1}
I20260807 00:39:05.018436 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.012546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58056 (local address 127.7.252.1:45329)
0807 00:39:05.012821 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.012824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.012987 (+ 163us) server_negotiation.cc:407] Connection header received
0807 00:39:05.013096 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.013100 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.013119 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.013205 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:05.014532 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.015649 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.017289 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.018065 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.018156 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.018244 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.018318 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.018358 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":125,"threads_started":1}
I20260807 00:39:05.018476 28059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2147cd30b7794e63a3fc31be5ea94015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:05.018394 27915 tablet_service.cc:1467] Processing CreateTablet for tablet 2147cd30b7794e63a3fc31be5ea94015 (DEFAULT_TABLE table=test-table [id=998fa585e6a049508f354fe045233f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:05.018872 27915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2147cd30b7794e63a3fc31be5ea94015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:05.021525 28148 tablet_bootstrap.cc:492] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Bootstrap starting.
I20260807 00:39:05.022169 27775 tablet_service.cc:1467] Processing CreateTablet for tablet 2147cd30b7794e63a3fc31be5ea94015 (DEFAULT_TABLE table=test-table [id=998fa585e6a049508f354fe045233f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:05.022539 27775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2147cd30b7794e63a3fc31be5ea94015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:05.022593 28149 tablet_bootstrap.cc:492] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Bootstrap starting.
I20260807 00:39:05.022744 28148 tablet_bootstrap.cc:654] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:05.023121 28148 log.cc:824] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:05.023381 28149 tablet_bootstrap.cc:654] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:05.023777 28149 log.cc:824] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:05.024013 28148 tablet_bootstrap.cc:492] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: No bootstrap required, opened a new log
I20260807 00:39:05.024092 28148 ts_tablet_manager.cc:1397] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 00:39:05.024629 28149 tablet_bootstrap.cc:492] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: No bootstrap required, opened a new log
I20260807 00:39:05.024696 28149 ts_tablet_manager.cc:1397] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:05.026090 28152 tablet_bootstrap.cc:492] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: Bootstrap starting.
I20260807 00:39:05.026856 28152 tablet_bootstrap.cc:654] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:05.026790 28148 raft_consensus.cc:348] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.026985 28148 raft_consensus.cc:374] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:05.027033 28148 raft_consensus.cc:729] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 942a91b79a4a4773937c5e90b03bdc10, State: Initialized, Role: FOLLOWER
I20260807 00:39:05.027197 28152 log.cc:824] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:05.027087 28149 raft_consensus.cc:348] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.027175 28148 consensus_queue.cc:260] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.027256 28149 raft_consensus.cc:374] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:05.027283 28149 raft_consensus.cc:729] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a44d46deaa7242878d0bb80d45b09a70, State: Initialized, Role: FOLLOWER
I20260807 00:39:05.027395 28149 consensus_queue.cc:260] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.027465 28148 ts_tablet_manager.cc:1428] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 00:39:05.027635 28149 ts_tablet_manager.cc:1428] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:05.027645 28132 heartbeater.cc:503] Master 127.7.252.62:33987 was elected leader, sending a full tablet report...
I20260807 00:39:05.027705 27988 heartbeater.cc:503] Master 127.7.252.62:33987 was elected leader, sending a full tablet report...
I20260807 00:39:05.028270 28152 tablet_bootstrap.cc:492] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: No bootstrap required, opened a new log
I20260807 00:39:05.028373 28152 ts_tablet_manager.cc:1397] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 00:39:05.030954 28152 raft_consensus.cc:348] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.031116 28152 raft_consensus.cc:374] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:05.031140 28152 raft_consensus.cc:729] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890a04c9ca564d6dbcd8f15afb857414, State: Initialized, Role: FOLLOWER
I20260807 00:39:05.031273 28152 consensus_queue.cc:260] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.031796 28152 ts_tablet_manager.cc:1428] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260807 00:39:05.031895 27846 heartbeater.cc:503] Master 127.7.252.62:33987 was elected leader, sending a full tablet report...
W20260807 00:39:05.091974 27989 tablet.cc:2369] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:39:05.190399 27847 tablet.cc:2369] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 00:39:05.239677 28134 tablet.cc:2369] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:05.490036 28156 raft_consensus.cc:482] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:39:05.490250 28156 raft_consensus.cc:504] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.490689 28156 leader_election.cc:288] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a44d46deaa7242878d0bb80d45b09a70 (127.7.252.2:33943), 942a91b79a4a4773937c5e90b03bdc10 (127.7.252.3:45831)
I20260807 00:39:05.494095 28158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.491033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:45831 (local address 127.7.252.1:37823)
0807 00:39:05.491182 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.491195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:05.491274 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:05.491645 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:05.491646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:05.491649 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:05.491730 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.491733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.492396 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.492397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.493239 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.493241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.493798 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.493799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.493878 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.493883 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:05.493955 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 00:39:05.494000 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260807 00:39:05.494083 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.491195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:37823 (local address 127.7.252.3:45831)
0807 00:39:05.491279 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.491281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.491329 (+ 48us) server_negotiation.cc:407] Connection header received
0807 00:39:05.491543 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.491544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.491557 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.491638 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:05.491814 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.492298 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.493341 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.493706 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.493794 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.493805 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.493960 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.494001 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 00:39:05.494463 28157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.491033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:33943 (local address 127.7.252.1:37775)
0807 00:39:05.491445 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.491457 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:05.491557 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:05.491790 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:05.491792 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:05.491794 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:05.491886 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.491887 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.492798 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.492799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.493566 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:05.493568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.494137 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.494139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:05.494232 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.494237 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:05.494334 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 00:39:05.494376 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260807 00:39:05.494505 28083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2147cd30b7794e63a3fc31be5ea94015" candidate_uuid: "890a04c9ca564d6dbcd8f15afb857414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "942a91b79a4a4773937c5e90b03bdc10" is_pre_election: true
I20260807 00:39:05.494710 28083 raft_consensus.cc:2454] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 890a04c9ca564d6dbcd8f15afb857414 in term 0.
I20260807 00:39:05.494819 28144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.491184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:37775 (local address 127.7.252.2:33943)
0807 00:39:05.491234 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.491236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.491541 (+ 305us) server_negotiation.cc:407] Connection header received
0807 00:39:05.491628 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.491629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.491640 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.491784 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:05.491957 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.492686 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.493682 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.494036 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.494123 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.494133 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.494642 (+ 509us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.494715 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:39:05.495035 27726 leader_election.cc:302] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890a04c9ca564d6dbcd8f15afb857414, 942a91b79a4a4773937c5e90b03bdc10; no voters:
I20260807 00:39:05.495106 27938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2147cd30b7794e63a3fc31be5ea94015" candidate_uuid: "890a04c9ca564d6dbcd8f15afb857414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a44d46deaa7242878d0bb80d45b09a70" is_pre_election: true
I20260807 00:39:05.495193 28156 raft_consensus.cc:2781] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:39:05.495265 28156 raft_consensus.cc:482] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:39:05.495296 28156 raft_consensus.cc:3037] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:05.495306 27938 raft_consensus.cc:2454] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 890a04c9ca564d6dbcd8f15afb857414 in term 0.
I20260807 00:39:05.496157 28156 raft_consensus.cc:504] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.496316 28156 leader_election.cc:288] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [CANDIDATE]: Term 1 election: Requested vote from peers a44d46deaa7242878d0bb80d45b09a70 (127.7.252.2:33943), 942a91b79a4a4773937c5e90b03bdc10 (127.7.252.3:45831)
I20260807 00:39:05.496515 27938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2147cd30b7794e63a3fc31be5ea94015" candidate_uuid: "890a04c9ca564d6dbcd8f15afb857414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a44d46deaa7242878d0bb80d45b09a70"
I20260807 00:39:05.496517 28083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2147cd30b7794e63a3fc31be5ea94015" candidate_uuid: "890a04c9ca564d6dbcd8f15afb857414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "942a91b79a4a4773937c5e90b03bdc10"
I20260807 00:39:05.496593 27938 raft_consensus.cc:3037] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:05.496671 28083 raft_consensus.cc:3037] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:05.497450 28083 raft_consensus.cc:2454] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 890a04c9ca564d6dbcd8f15afb857414 in term 1.
I20260807 00:39:05.497454 27938 raft_consensus.cc:2454] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 890a04c9ca564d6dbcd8f15afb857414 in term 1.
I20260807 00:39:05.497663 27726 leader_election.cc:302] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890a04c9ca564d6dbcd8f15afb857414, 942a91b79a4a4773937c5e90b03bdc10; no voters:
I20260807 00:39:05.497807 28156 raft_consensus.cc:2781] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:05.497985 28156 raft_consensus.cc:686] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 1 LEADER]: Becoming Leader. State: Replica: 890a04c9ca564d6dbcd8f15afb857414, State: Running, Role: LEADER
I20260807 00:39:05.498098 28156 consensus_queue.cc:237] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } }
I20260807 00:39:05.499071 27647 catalog_manager.cc:5495] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 reported cstate change: term changed from 0 to 1, leader changed from <none> to 890a04c9ca564d6dbcd8f15afb857414 (127.7.252.1). New cstate: current_term: 1 leader_uuid: "890a04c9ca564d6dbcd8f15afb857414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "890a04c9ca564d6dbcd8f15afb857414" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 45329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260807 00:39:05.572962 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.569919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58066 (local address 127.7.252.1:45329)
0807 00:39:05.570067 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:05.570069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:05.570078 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:05.570118 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:05.570119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:05.570141 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:05.570324 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:05.570553 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.571124 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.572015 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:05.572275 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:05.572354 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:05.572603 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:05.572698 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:05.572803 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:05.572884 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 00:39:05.572893 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260807 00:39:05.574878 28083 raft_consensus.cc:1261] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 1 FOLLOWER]: Refusing update from remote peer 890a04c9ca564d6dbcd8f15afb857414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:05.574909 27938 raft_consensus.cc:1261] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 1 FOLLOWER]: Refusing update from remote peer 890a04c9ca564d6dbcd8f15afb857414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:05.575351 28159 consensus_queue.cc:1035] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "942a91b79a4a4773937c5e90b03bdc10" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:05.575650 28156 consensus_queue.cc:1035] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a44d46deaa7242878d0bb80d45b09a70" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 33943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:05.579581 28169 mvcc.cc:205] Tried to move back new op lower bound from 7315714644271734784 to 7315714643960897536. Current Snapshot: MvccSnapshot[applied={T|T < 7315714644271734784 or (T in {7315714644271734784})}]
I20260807 00:39:05.579734 28168 mvcc.cc:205] Tried to move back new op lower bound from 7315714644271734784 to 7315714643960897536. Current Snapshot: MvccSnapshot[applied={T|T < 7315714644271734784}]
I20260807 00:39:05.581308 27647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:05.581418 27647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:05.582412 27647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 174d43f20f874b59b5ffff452ba95e46: Sending DeleteTablet for 3 replicas of tablet 2147cd30b7794e63a3fc31be5ea94015
I20260807 00:39:05.582901 27775 tablet_service.cc:1514] Processing DeleteTablet for tablet 2147cd30b7794e63a3fc31be5ea94015 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:05 UTC) from {username='slave'} at 127.0.0.1:58056
I20260807 00:39:05.582965 27915 tablet_service.cc:1514] Processing DeleteTablet for tablet 2147cd30b7794e63a3fc31be5ea94015 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:05 UTC) from {username='slave'} at 127.0.0.1:39498
I20260807 00:39:05.583222 28176 tablet_replica.cc:330] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414: stopping tablet replica
I20260807 00:39:05.583205 28059 tablet_service.cc:1514] Processing DeleteTablet for tablet 2147cd30b7794e63a3fc31be5ea94015 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:05 UTC) from {username='slave'} at 127.0.0.1:45568
I20260807 00:39:05.583361 28176 raft_consensus.cc:2229] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:39:05.583479 28176 raft_consensus.cc:2258] T 2147cd30b7794e63a3fc31be5ea94015 P 890a04c9ca564d6dbcd8f15afb857414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:05.583567 28178 tablet_replica.cc:330] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: stopping tablet replica
I20260807 00:39:05.583585 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27710
I20260807 00:39:05.584136 28178 raft_consensus.cc:2229] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:05.584317 28178 raft_consensus.cc:2258] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:05.584745 28178 ts_tablet_manager.cc:1905] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:05.586561 28178 ts_tablet_manager.cc:1918] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:05.586892 28178 log.cc:1196] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/2147cd30b7794e63a3fc31be5ea94015
I20260807 00:39:05.587311 28178 ts_tablet_manager.cc:1939] T 2147cd30b7794e63a3fc31be5ea94015 P 942a91b79a4a4773937c5e90b03bdc10: Deleting consensus metadata
I20260807 00:39:05.587762 27632 catalog_manager.cc:4841] TS 942a91b79a4a4773937c5e90b03bdc10 (127.7.252.3:45831): tablet 2147cd30b7794e63a3fc31be5ea94015 (table test-table [id=998fa585e6a049508f354fe045233f4c]) successfully deleted
I20260807 00:39:05.590905 28177 tablet_replica.cc:330] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: stopping tablet replica
I20260807 00:39:05.591115 28177 raft_consensus.cc:2229] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:05.591370 28177 raft_consensus.cc:2258] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 00:39:05.591910 27632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:45329 (error 108)
I20260807 00:39:05.591964 28177 ts_tablet_manager.cc:1905] T 2147cd30b7794e63a3fc31be5ea94015 P a44d46deaa7242878d0bb80d45b09a70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:05.592176 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27849
I20260807 00:39:05.592543 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.592330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:45329 (local address 127.0.0.1:58070)
0807 00:39:05.592439 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.592491 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":46,"threads_started":1}
W20260807 00:39:05.592705 27632 catalog_manager.cc:4584] TS 890a04c9ca564d6dbcd8f15afb857414 (127.7.252.1:45329): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2147cd30b7794e63a3fc31be5ea94015: Network error: Client connection negotiation failed: client connection to 127.7.252.1:45329: connect: Connection refused (error 111)
I20260807 00:39:05.599176 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:05.599025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:33943 (local address 127.0.0.1:39504)
0807 00:39:05.599098 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:05.599135 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.2:33943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 00:39:05.599185 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27991
I20260807 00:39:05.606567 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 27617
2026-08-07T00:39:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1258 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:05 dist-test-slave-csg5 krb5kdc[28183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:05 dist-test-slave-csg5 krb5kdc[28183](info): set up 2 sockets
Aug 07 00:39:05 dist-test-slave-csg5 krb5kdc[28183](info): commencing operation
krb5kdc: starting...
W20260807 00:39:06.712826 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:06 dist-test-slave-csg5 krb5kdc[28183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:06.854460 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:37609
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:37609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:06.947130 28197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:06.947443 28197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:06.947490 28197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:06.948794 28197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:06.948879 28197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:06.948902 28197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:06.948925 28197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:06.948956 28197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:06.950623 28197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:37609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:37609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:06.950994 28197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:06.951272 28197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:06.956895 28203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:06.956907 28205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:06.956916 28197 server_base.cc:1034] running on GCE node
W20260807 00:39:06.956883 28202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:06.957443 28197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:06.957823 28197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:06.959031 28197 hybrid_clock.cc:648] HybridClock initialized: now 1786063146959020 us; error 41 us; skew 500 ppm
Aug 07 00:39:06 dist-test-slave-csg5 krb5kdc[28183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063146, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:06.962092 28197 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:06.962764 28197 webserver.cc:460] Webserver started at http://127.7.252.62:39505/ using document root <none> and password file <none>
I20260807 00:39:06.963030 28197 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:06.963102 28197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:06.963279 28197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:06.964395 28197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31"
format_stamp: "Formatted at 2026-08-07 00:39:06 on dist-test-slave-csg5"
server_key: "b500c7540a19ee491bf8b9dbbc5c208d"
server_key_iv: "8b7b22b8b5fb8374ea68fbf0df05493d"
server_key_version: "encryptionkey@0"
I20260807 00:39:06.964784 28197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31"
format_stamp: "Formatted at 2026-08-07 00:39:06 on dist-test-slave-csg5"
server_key: "b500c7540a19ee491bf8b9dbbc5c208d"
server_key_iv: "8b7b22b8b5fb8374ea68fbf0df05493d"
server_key_version: "encryptionkey@0"
I20260807 00:39:06.966354 28197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:06.967437 28213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:06.967658 28197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:06.967777 28197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31"
format_stamp: "Formatted at 2026-08-07 00:39:06 on dist-test-slave-csg5"
server_key: "b500c7540a19ee491bf8b9dbbc5c208d"
server_key_iv: "8b7b22b8b5fb8374ea68fbf0df05493d"
server_key_version: "encryptionkey@0"
I20260807 00:39:06.967895 28197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:06.988152 28197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:06.990880 28197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:06.991014 28197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:06.995149 28197 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:37609
I20260807 00:39:06.995222 28265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:37609 every 8 connection(s)
I20260807 00:39:06.995596 28197 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:06.996577 28266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:06.999162 28266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31: Bootstrap starting.
I20260807 00:39:06.999799 28266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:07.000146 28266 log.cc:824] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:07.001010 28266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31: No bootstrap required, opened a new log
I20260807 00:39:07.001116 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28197
I20260807 00:39:07.001267 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:07.001492 8176 external_mini_cluster.cc:1428] Setting key 9f2aed7e2033c46331d293f196760aa7
I20260807 00:39:07.003369 28266 raft_consensus.cc:348] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37609 } }
I20260807 00:39:07.003539 28266 raft_consensus.cc:374] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:07.003564 28266 raft_consensus.cc:729] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daff1b6d5a6c4cdb8e8c3c7062453a31, State: Initialized, Role: FOLLOWER
I20260807 00:39:07.003724 28266 consensus_queue.cc:260] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37609 } }
I20260807 00:39:07.003844 28266 raft_consensus.cc:388] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:07.003903 28266 raft_consensus.cc:482] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:07.003979 28266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:07.005014 28266 raft_consensus.cc:504] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37609 } }
I20260807 00:39:07.005170 28266 leader_election.cc:302] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daff1b6d5a6c4cdb8e8c3c7062453a31; no voters:
I20260807 00:39:07.005396 28266 leader_election.cc:288] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:07.005424 28271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:07.005543 28271 raft_consensus.cc:686] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [term 1 LEADER]: Becoming Leader. State: Replica: daff1b6d5a6c4cdb8e8c3c7062453a31, State: Running, Role: LEADER
I20260807 00:39:07.005632 28271 consensus_queue.cc:237] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37609 } }
I20260807 00:39:07.005707 28266 sys_catalog.cc:564] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:07.005985 28272 sys_catalog.cc:455] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daff1b6d5a6c4cdb8e8c3c7062453a31. Latest consensus state: current_term: 1 leader_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37609 } } }
I20260807 00:39:07.006091 28272 sys_catalog.cc:458] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:07.006307 28273 sys_catalog.cc:455] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daff1b6d5a6c4cdb8e8c3c7062453a31" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37609 } } }
I20260807 00:39:07.006383 28273 sys_catalog.cc:458] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:07.006857 28277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:07.007488 28277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:07.009076 28277 catalog_manager.cc:1347] Generated new cluster ID: 5b15d5f7296f41daa7d4259ca952545a
I20260807 00:39:07.009130 28277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:07.016826 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.002085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60564 (local address 127.7.252.62:37609)
0807 00:39:07.002416 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.002426 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.002456 (+ 30us) server_negotiation.cc:407] Connection header received
0807 00:39:07.003423 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.003432 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.003493 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.003682 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:07.004613 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.006077 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.007390 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.008087 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.008227 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.011506 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:07.011511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:07.011511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:07.011526 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:07.013930 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.014457 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.014462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.014462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.014618 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.014936 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.014937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.014938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.015320 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:07.015505 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.016155 (+ 650us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.016348 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
I20260807 00:39:07.020418 28277 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:07.021106 28277 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:07.032778 28277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31: Generated new TSK 0
I20260807 00:39:07.033053 28277 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.252.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
Entry for principal kudu/127.7.252.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab.
I20260807 00:39:07.071213 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37609
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:07.160329 28294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:07.160560 28294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:07.160588 28294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:07.161774 28294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:07.161824 28294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:07.161852 28294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:39:07.163478 28294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.1.keytab
--principal=kudu/127.7.252.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:07.163714 28294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:07.163930 28294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:07.173069 28302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:07.173074 28299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:07.173441 28294 server_base.cc:1034] running on GCE node
W20260807 00:39:07.173069 28300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:07.173770 28294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:07.174065 28294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:07.175359 28294 hybrid_clock.cc:648] HybridClock initialized: now 1786063147175347 us; error 39 us; skew 500 ppm
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063147, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:07.178493 28294 init.cc:377] Logged in from keytab as kudu/127.7.252.1@KRBTEST.COM (short username kudu)
I20260807 00:39:07.179024 28294 webserver.cc:460] Webserver started at http://127.7.252.1:42809/ using document root <none> and password file <none>
I20260807 00:39:07.179232 28294 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:07.179277 28294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:07.179378 28294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:07.180473 28294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "30323f88575e87fe0e3fe6510a95ca71"
server_key_iv: "e1c6b3d2b46250e84863bd57782b08d9"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.180810 28294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "30323f88575e87fe0e3fe6510a95ca71"
server_key_iv: "e1c6b3d2b46250e84863bd57782b08d9"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.182268 28294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:07.183225 28309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.183458 28294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:39:07.183557 28294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "30323f88575e87fe0e3fe6510a95ca71"
server_key_iv: "e1c6b3d2b46250e84863bd57782b08d9"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.183622 28294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:07.194849 28294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:07.197432 28294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:07.197605 28294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:07.197911 28294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:07.198279 28294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:07.198315 28294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.198340 28294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:07.198354 28294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.204890 28294 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42211
I20260807 00:39:07.204975 28431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42211 every 8 connection(s)
I20260807 00:39:07.205356 28294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:39:07.207926 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28294
I20260807 00:39:07.208092 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:39:07.208360 8176 external_mini_cluster.cc:1428] Setting key 1a1815a27d74add42415cc7b20bfe05b
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063147, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.1@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:07.218528 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.206451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:54361 (local address 127.7.252.62:37609)
0807 00:39:07.206574 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.206577 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.206846 (+ 269us) server_negotiation.cc:407] Connection header received
0807 00:39:07.207429 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.207430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.207446 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.207503 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:07.208895 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.209489 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.211136 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.211497 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.211593 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.214490 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:07.214493 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:07.214494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:07.214505 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:07.216421 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.217139 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.217140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.217141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.217213 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.217542 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.217544 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.217544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.217694 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:07.217784 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.218135 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.218414 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 00:39:07.218847 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.206324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:37609 (local address 127.7.252.1:54361)
0807 00:39:07.206606 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.206678 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.207299 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.207586 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.207589 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.208504 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:07.208793 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.208801 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.209593 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.209595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.210986 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.210991 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.211638 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.211640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.211768 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.212433 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:07.212442 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:07.214330 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:07.216721 (+ 2391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:07.216743 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:07.216746 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:07.217046 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:07.217287 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:07.217288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:07.217288 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:07.217454 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:07.217784 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:07.217793 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:07.217974 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.218110 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.218504 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.7.252.2@KRBTEST.COM; defaulting to no policy
I20260807 00:39:07.219537 28432 heartbeater.cc:347] Connected to a master server at 127.7.252.62:37609
I20260807 00:39:07.219673 28432 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:07.219885 28432 heartbeater.cc:511] Master 127.7.252.62:37609 requested a full tablet report, sending...
I20260807 00:39:07.220582 28230 ts_manager.cc:194] Registered new tserver with Master: 9b069e57b9ad4a1a9b6619cd01aae8ab (127.7.252.1:42211)
I20260807 00:39:07.221427 28230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.1@KRBTEST.COM'} at 127.7.252.1:54361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
Entry for principal kudu/127.7.252.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab.
I20260807 00:39:07.250229 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37609
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:07.340595 28437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:07.340852 28437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:07.340880 28437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:07.342196 28437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:07.342249 28437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:07.342285 28437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:39:07.343930 28437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.2.keytab
--principal=kudu/127.7.252.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:07.344218 28437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:07.344482 28437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:07.350493 28446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:07.350585 28444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:07.350642 28437 server_base.cc:1034] running on GCE node
W20260807 00:39:07.350493 28443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:07.351130 28437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:07.351462 28437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:07.352608 28437 hybrid_clock.cc:648] HybridClock initialized: now 1786063147352577 us; error 41 us; skew 500 ppm
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063147, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:07.356052 28437 init.cc:377] Logged in from keytab as kudu/127.7.252.2@KRBTEST.COM (short username kudu)
I20260807 00:39:07.356698 28437 webserver.cc:460] Webserver started at http://127.7.252.2:45207/ using document root <none> and password file <none>
I20260807 00:39:07.356973 28437 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:07.357052 28437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:07.357230 28437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:07.358422 28437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "689e8f860639493da8d358f4ad2ba98e"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "12d62d37e9387b3b7c99c5481aaaeca4"
server_key_iv: "2728ffb07b9429c1030d777631e76bdb"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.358896 28437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "689e8f860639493da8d358f4ad2ba98e"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "12d62d37e9387b3b7c99c5481aaaeca4"
server_key_iv: "2728ffb07b9429c1030d777631e76bdb"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.360775 28437 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 00:39:07.361773 28453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.362085 28437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:07.362296 28437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "689e8f860639493da8d358f4ad2ba98e"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "12d62d37e9387b3b7c99c5481aaaeca4"
server_key_iv: "2728ffb07b9429c1030d777631e76bdb"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.362407 28437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:07.398933 28437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:07.401715 28437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:07.401911 28437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:07.402184 28437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:07.402565 28437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:07.402623 28437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.402658 28437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:07.402781 28437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.409649 28437 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:38467
I20260807 00:39:07.409699 28568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:38467 every 8 connection(s)
I20260807 00:39:07.410095 28437 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063147, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.2@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:07.418107 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28437
I20260807 00:39:07.418265 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:39:07.418490 8176 external_mini_cluster.cc:1428] Setting key 38fc071dc312511156b3ef623080c68e
I20260807 00:39:07.421608 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.411002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:56037 (local address 127.7.252.62:37609)
0807 00:39:07.411086 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.411088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.411435 (+ 347us) server_negotiation.cc:407] Connection header received
0807 00:39:07.412019 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.412020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.412033 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.412108 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:07.413526 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.414099 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.415389 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.415599 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.415673 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.418415 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:07.418422 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:07.418423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:07.418430 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:07.420127 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.420586 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.420587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.420588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.420650 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.420929 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.420930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.420930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.421053 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:07.421130 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.421420 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.421508 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:39:07.421839 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.410977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:37609 (local address 127.7.252.2:56037)
0807 00:39:07.411196 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.411246 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.411770 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.412424 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.412429 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.413167 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:07.413399 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.413404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.414256 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.414257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.415281 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.415284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.415727 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.415728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.415862 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.416574 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:07.416583 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:07.418269 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:07.420239 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:07.420247 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:07.420250 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:07.420503 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:07.420723 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:07.420723 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:07.420724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:07.420852 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:07.421121 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:07.421128 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:07.421281 (+ 153us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.421399 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.421575 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":129,"threads_started":1}
I20260807 00:39:07.422525 28569 heartbeater.cc:347] Connected to a master server at 127.7.252.62:37609
I20260807 00:39:07.422640 28569 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:07.422915 28569 heartbeater.cc:511] Master 127.7.252.62:37609 requested a full tablet report, sending...
I20260807 00:39:07.423564 28230 ts_manager.cc:194] Registered new tserver with Master: 689e8f860639493da8d358f4ad2ba98e (127.7.252.2:38467)
I20260807 00:39:07.424053 28230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.2@KRBTEST.COM'} at 127.7.252.2:56037
WARNING: no policy specified for kudu/127.7.252.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
Entry for principal kudu/127.7.252.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab.
I20260807 00:39:07.451467 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37609
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:33319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:07.543607 28574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:07.543892 28574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:07.543923 28574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:07.545254 28574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:07.545298 28574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:07.545329 28574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:39:07.547041 28574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:33319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.3.keytab
--principal=kudu/127.7.252.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:07.547477 28574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:07.547851 28574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:39:07.553531 28574 server_base.cc:1034] running on GCE node
W20260807 00:39:07.553531 28579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:07.553625 28583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:07.553540 28580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:07.554051 28574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:07.554322 28574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:07.555505 28574 hybrid_clock.cc:648] HybridClock initialized: now 1786063147555488 us; error 46 us; skew 500 ppm
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063147, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:07.558560 28574 init.cc:377] Logged in from keytab as kudu/127.7.252.3@KRBTEST.COM (short username kudu)
I20260807 00:39:07.559322 28574 webserver.cc:460] Webserver started at http://127.7.252.3:38705/ using document root <none> and password file <none>
I20260807 00:39:07.559587 28574 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:07.559664 28574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:07.559821 28574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:07.560949 28574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "78e0f37f3cd442e8a6508f9271815e71"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "755df0e6312555f808ce308cbadcf192"
server_key_iv: "295365f9a1520f6de012b6b9e16105a0"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.561358 28574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "78e0f37f3cd442e8a6508f9271815e71"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "755df0e6312555f808ce308cbadcf192"
server_key_iv: "295365f9a1520f6de012b6b9e16105a0"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.562989 28574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 00:39:07.564077 28591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.564347 28574 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:07.564473 28574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "78e0f37f3cd442e8a6508f9271815e71"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "755df0e6312555f808ce308cbadcf192"
server_key_iv: "295365f9a1520f6de012b6b9e16105a0"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.564563 28574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:07.574501 28574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:07.577034 28574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:07.577226 28574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:07.577502 28574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:07.577920 28574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:07.577992 28574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.578042 28574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:07.578071 28574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.584820 28574 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:43575
I20260807 00:39:07.584859 28708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:43575 every 8 connection(s)
I20260807 00:39:07.585239 28574 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:39:07.588019 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28574
I20260807 00:39:07.588153 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:39:07.588351 8176 external_mini_cluster.cc:1428] Setting key 5f77dacc1b0f7fd222e41aa690f6dbb8
Aug 07 00:39:07 dist-test-slave-csg5 krb5kdc[28183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063147, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.3@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:07.596004 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.586083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:46975 (local address 127.7.252.62:37609)
0807 00:39:07.586191 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.586194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.586359 (+ 165us) server_negotiation.cc:407] Connection header received
0807 00:39:07.586974 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.586976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.586988 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.587081 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:07.588464 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.589149 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.590258 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.590474 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.590564 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.593054 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:07.593056 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:07.593057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:07.593065 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:07.594486 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.594968 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.594969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.594969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.595033 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.595308 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.595309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.595309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.595441 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:07.595521 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.595821 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.595907 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 00:39:07.596210 28711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.586022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:37609 (local address 127.7.252.3:46975)
0807 00:39:07.586222 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.586270 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.586878 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.587154 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.587157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.587955 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:07.588304 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.588311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.589255 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.589257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.590163 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.590166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.590575 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.590576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.590754 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.591287 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:07.591296 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:07.592948 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:07.594595 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:07.594602 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:07.594605 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:07.594886 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:07.595103 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:07.595104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:07.595104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:07.595231 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:07.595511 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:07.595519 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:07.595677 (+ 158us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.595786 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.595955 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":115,"threads_started":1}
I20260807 00:39:07.596895 28709 heartbeater.cc:347] Connected to a master server at 127.7.252.62:37609
I20260807 00:39:07.596987 28709 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:07.597193 28709 heartbeater.cc:511] Master 127.7.252.62:37609 requested a full tablet report, sending...
I20260807 00:39:07.597687 28230 ts_manager.cc:194] Registered new tserver with Master: 78e0f37f3cd442e8a6508f9271815e71 (127.7.252.3:43575)
I20260807 00:39:07.598126 28230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.252.3@KRBTEST.COM'} at 127.7.252.3:46975
I20260807 00:39:07.600615 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:39:07.609246 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.602166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.7.252.62:37609)
0807 00:39:07.602215 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.602220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.602316 (+ 96us) server_negotiation.cc:407] Connection header received
0807 00:39:07.602385 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.602386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.602395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.602450 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:07.603336 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.603951 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.604800 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.605018 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.605081 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.606494 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:07.606495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:07.606495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:07.606502 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:07.608041 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.608398 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.608399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.608399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.608457 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:07.608659 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:07.608660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:07.608661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:07.608880 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:07.608974 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.609100 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.609168 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:39:07.611603 28230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:39:07.613351 28230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:39:07.620621 28723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.616141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58186 (local address 127.7.252.3:43575)
0807 00:39:07.616533 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.616537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.616547 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:07.616589 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.616592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.616609 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.616686 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:07.616976 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.618170 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.619478 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.620056 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.620126 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.620189 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.620469 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.620522 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":94,"threads_started":1}
I20260807 00:39:07.620622 28722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.616033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:43575 (local address 127.0.0.1:58186)
0807 00:39:07.616260 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.616316 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.616382 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.616783 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.616787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.616790 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:07.616887 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.616889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.618296 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.618297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.619401 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.619403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.620226 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.620227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.620311 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.620318 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.620391 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.620520 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":73,"thread_start_us":68,"threads_started":1}
I20260807 00:39:07.620625 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.616065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:38467 (local address 127.0.0.1:47696)
0807 00:39:07.616461 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.616473 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.616564 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.616792 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.616793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.616796 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:07.616882 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.616884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.617968 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.617969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.619331 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.619334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.620215 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.620216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.620302 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.620316 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.620427 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.620538 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":27,"thread_start_us":95,"threads_started":1}
I20260807 00:39:07.620999 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.616210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47696 (local address 127.7.252.2:38467)
0807 00:39:07.616405 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.616410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.616535 (+ 125us) server_negotiation.cc:407] Connection header received
0807 00:39:07.616650 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.616653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.616668 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.616960 (+ 292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:07.617037 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.617853 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.619429 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.620120 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.620214 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.620272 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.620658 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.620887 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
I20260807 00:39:07.621630 28502 tablet_service.cc:1467] Processing CreateTablet for tablet 54bd36c748244d1b8d9a4094d362d99b (DEFAULT_TABLE table=test-table [id=902c09175d3049d8a55509ea180a491c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:07.621630 28641 tablet_service.cc:1467] Processing CreateTablet for tablet 54bd36c748244d1b8d9a4094d362d99b (DEFAULT_TABLE table=test-table [id=902c09175d3049d8a55509ea180a491c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:07.622020 28502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54bd36c748244d1b8d9a4094d362d99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:07.622020 28641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54bd36c748244d1b8d9a4094d362d99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:07.623303 28721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.616274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42211 (local address 127.0.0.1:60524)
0807 00:39:07.616484 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.616494 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.616531 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.616933 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.616934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.616936 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:07.616970 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.616971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.618736 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.618737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.619844 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.619847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.623021 (+ 3174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.623023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.623094 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.623099 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.623162 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.623214 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":67,"threads_started":1}
I20260807 00:39:07.623515 28726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.616511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60524 (local address 127.7.252.1:42211)
0807 00:39:07.616701 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.616705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.616715 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:07.616752 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.616754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.616769 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.616840 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:07.617099 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.618165 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.619954 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.622895 (+ 2941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.623019 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.623087 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.623179 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.623226 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
I20260807 00:39:07.625797 28727 tablet_bootstrap.cc:492] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Bootstrap starting.
I20260807 00:39:07.626269 28359 tablet_service.cc:1467] Processing CreateTablet for tablet 54bd36c748244d1b8d9a4094d362d99b (DEFAULT_TABLE table=test-table [id=902c09175d3049d8a55509ea180a491c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:07.626596 28727 tablet_bootstrap.cc:654] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:07.626602 28359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54bd36c748244d1b8d9a4094d362d99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:07.627174 28727 log.cc:824] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:07.627556 28728 tablet_bootstrap.cc:492] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Bootstrap starting.
I20260807 00:39:07.628099 28727 tablet_bootstrap.cc:492] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: No bootstrap required, opened a new log
I20260807 00:39:07.628181 28727 ts_tablet_manager.cc:1397] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:07.628702 28728 tablet_bootstrap.cc:654] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:07.629292 28728 log.cc:824] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:07.630098 28732 tablet_bootstrap.cc:492] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab: Bootstrap starting.
I20260807 00:39:07.630230 28728 tablet_bootstrap.cc:492] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: No bootstrap required, opened a new log
I20260807 00:39:07.630311 28728 ts_tablet_manager.cc:1397] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:07.630314 28727 raft_consensus.cc:348] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.630529 28727 raft_consensus.cc:374] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:07.630574 28727 raft_consensus.cc:729] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e0f37f3cd442e8a6508f9271815e71, State: Initialized, Role: FOLLOWER
I20260807 00:39:07.630743 28727 consensus_queue.cc:260] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.630970 28732 tablet_bootstrap.cc:654] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:07.631084 28727 ts_tablet_manager.cc:1428] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:07.631208 28709 heartbeater.cc:503] Master 127.7.252.62:37609 was elected leader, sending a full tablet report...
I20260807 00:39:07.631670 28732 log.cc:824] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:07.632622 28732 tablet_bootstrap.cc:492] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab: No bootstrap required, opened a new log
I20260807 00:39:07.632710 28732 ts_tablet_manager.cc:1397] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:07.633064 28728 raft_consensus.cc:348] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.633219 28728 raft_consensus.cc:374] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:07.633244 28728 raft_consensus.cc:729] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 689e8f860639493da8d358f4ad2ba98e, State: Initialized, Role: FOLLOWER
I20260807 00:39:07.633420 28728 consensus_queue.cc:260] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.633742 28728 ts_tablet_manager.cc:1428] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 00:39:07.633767 28569 heartbeater.cc:503] Master 127.7.252.62:37609 was elected leader, sending a full tablet report...
I20260807 00:39:07.634701 28732 raft_consensus.cc:348] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.634913 28732 raft_consensus.cc:374] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:07.634956 28732 raft_consensus.cc:729] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b069e57b9ad4a1a9b6619cd01aae8ab, State: Initialized, Role: FOLLOWER
I20260807 00:39:07.635100 28732 consensus_queue.cc:260] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.635387 28732 ts_tablet_manager.cc:1428] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:07.635411 28432 heartbeater.cc:503] Master 127.7.252.62:37609 was elected leader, sending a full tablet report...
W20260807 00:39:07.660745 28570 tablet.cc:2369] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:07.671368 28733 raft_consensus.cc:482] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:39:07.671519 28733 raft_consensus.cc:504] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.671973 28733 leader_election.cc:288] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 689e8f860639493da8d358f4ad2ba98e (127.7.252.2:38467), 9b069e57b9ad4a1a9b6619cd01aae8ab (127.7.252.1:42211)
I20260807 00:39:07.675499 28711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.672175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:38467 (local address 127.7.252.3:48125)
0807 00:39:07.672253 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.672272 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.672433 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.672629 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.672631 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.672633 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:07.672724 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.672727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.673465 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.673466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.674365 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.674367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.675163 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.675164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.675262 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.675266 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.675337 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.675391 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":13}
I20260807 00:39:07.675539 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.672433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:48125 (local address 127.7.252.2:38467)
0807 00:39:07.672488 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.672490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.672500 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:07.672533 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.672533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.672547 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.672608 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:07.672813 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.673375 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.674467 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.675100 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.675154 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.675164 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.675419 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.675465 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 00:39:07.675592 28726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.672418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:47553 (local address 127.7.252.1:42211)
0807 00:39:07.672477 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.672480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.672607 (+ 127us) server_negotiation.cc:407] Connection header received
0807 00:39:07.672638 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.672639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.672652 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.672720 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:07.672934 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.673465 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.674521 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.675202 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.675280 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.675291 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.675468 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.675512 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 00:39:07.675642 28737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.672295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42211 (local address 127.7.252.3:47553)
0807 00:39:07.672494 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.672504 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:07.672580 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:07.672729 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:07.672730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:07.672731 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:07.672830 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.672832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.673556 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.673557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.674378 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:07.674381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.675286 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.675287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:07.675355 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.675360 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:07.675442 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 00:39:07.675478 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":2,"thread_start_us":120,"threads_started":1}
I20260807 00:39:07.675911 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bd36c748244d1b8d9a4094d362d99b" candidate_uuid: "78e0f37f3cd442e8a6508f9271815e71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "689e8f860639493da8d358f4ad2ba98e" is_pre_election: true
I20260807 00:39:07.675967 28379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bd36c748244d1b8d9a4094d362d99b" candidate_uuid: "78e0f37f3cd442e8a6508f9271815e71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" is_pre_election: true
I20260807 00:39:07.676112 28379 raft_consensus.cc:2454] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78e0f37f3cd442e8a6508f9271815e71 in term 0.
I20260807 00:39:07.676112 28522 raft_consensus.cc:2454] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78e0f37f3cd442e8a6508f9271815e71 in term 0.
I20260807 00:39:07.676363 28592 leader_election.cc:302] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 689e8f860639493da8d358f4ad2ba98e, 78e0f37f3cd442e8a6508f9271815e71; no voters:
I20260807 00:39:07.676507 28733 raft_consensus.cc:2781] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:39:07.676605 28733 raft_consensus.cc:482] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:39:07.676642 28733 raft_consensus.cc:3037] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:07.677392 28733 raft_consensus.cc:504] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.677549 28733 leader_election.cc:288] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [CANDIDATE]: Term 1 election: Requested vote from peers 689e8f860639493da8d358f4ad2ba98e (127.7.252.2:38467), 9b069e57b9ad4a1a9b6619cd01aae8ab (127.7.252.1:42211)
I20260807 00:39:07.677802 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bd36c748244d1b8d9a4094d362d99b" candidate_uuid: "78e0f37f3cd442e8a6508f9271815e71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "689e8f860639493da8d358f4ad2ba98e"
I20260807 00:39:07.677807 28379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54bd36c748244d1b8d9a4094d362d99b" candidate_uuid: "78e0f37f3cd442e8a6508f9271815e71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab"
I20260807 00:39:07.677899 28379 raft_consensus.cc:3037] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:07.677899 28522 raft_consensus.cc:3037] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:07.678941 28522 raft_consensus.cc:2454] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78e0f37f3cd442e8a6508f9271815e71 in term 1.
I20260807 00:39:07.678941 28379 raft_consensus.cc:2454] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78e0f37f3cd442e8a6508f9271815e71 in term 1.
I20260807 00:39:07.679215 28592 leader_election.cc:302] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 689e8f860639493da8d358f4ad2ba98e, 78e0f37f3cd442e8a6508f9271815e71; no voters:
I20260807 00:39:07.679409 28733 raft_consensus.cc:2781] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:07.679570 28733 raft_consensus.cc:686] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 1 LEADER]: Becoming Leader. State: Replica: 78e0f37f3cd442e8a6508f9271815e71, State: Running, Role: LEADER
I20260807 00:39:07.679674 28733 consensus_queue.cc:237] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } }
I20260807 00:39:07.680635 28230 catalog_manager.cc:5495] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78e0f37f3cd442e8a6508f9271815e71 (127.7.252.3). New cstate: current_term: 1 leader_uuid: "78e0f37f3cd442e8a6508f9271815e71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78e0f37f3cd442e8a6508f9271815e71" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 } health_report { overall_health: UNKNOWN } } }
I20260807 00:39:07.695931 28723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.692628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58198 (local address 127.7.252.3:43575)
0807 00:39:07.692738 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.692740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.692748 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:39:07.692785 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.692785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.692808 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.692896 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:07.693076 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.693620 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.694896 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.695259 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.695325 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.695474 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:07.695577 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:07.695636 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.695794 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.695828 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 00:39:07.697901 28379 raft_consensus.cc:1261] T 54bd36c748244d1b8d9a4094d362d99b P 9b069e57b9ad4a1a9b6619cd01aae8ab [term 1 FOLLOWER]: Refusing update from remote peer 78e0f37f3cd442e8a6508f9271815e71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:07.697925 28522 raft_consensus.cc:1261] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 1 FOLLOWER]: Refusing update from remote peer 78e0f37f3cd442e8a6508f9271815e71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:07.698324 28738 consensus_queue.cc:1035] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b069e57b9ad4a1a9b6619cd01aae8ab" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:07.698465 28733 consensus_queue.cc:1035] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "689e8f860639493da8d358f4ad2ba98e" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 38467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:07.700883 28741 mvcc.cc:205] Tried to move back new op lower bound from 7315714652967739392 to 7315714652896792576. Current Snapshot: MvccSnapshot[applied={T|T < 7315714652967739392}]
I20260807 00:39:07.701339 28742 mvcc.cc:205] Tried to move back new op lower bound from 7315714652967739392 to 7315714652896792576. Current Snapshot: MvccSnapshot[applied={T|T < 7315714652967739392}]
I20260807 00:39:07.701958 28743 mvcc.cc:205] Tried to move back new op lower bound from 7315714652967739392 to 7315714652896792576. Current Snapshot: MvccSnapshot[applied={T|T < 7315714652967739392 or (T in {7315714652967739392})}]
I20260807 00:39:07.703552 28230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:07.703706 28230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:07.704747 28230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P daff1b6d5a6c4cdb8e8c3c7062453a31: Sending DeleteTablet for 3 replicas of tablet 54bd36c748244d1b8d9a4094d362d99b
I20260807 00:39:07.705181 28502 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bd36c748244d1b8d9a4094d362d99b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:07 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:47696
I20260807 00:39:07.705220 28359 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bd36c748244d1b8d9a4094d362d99b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:07 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:60524
I20260807 00:39:07.705466 28751 tablet_replica.cc:330] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: stopping tablet replica
I20260807 00:39:07.705595 28751 raft_consensus.cc:2229] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:07.705786 28751 raft_consensus.cc:2258] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:07.705832 28641 tablet_service.cc:1514] Processing DeleteTablet for tablet 54bd36c748244d1b8d9a4094d362d99b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:07 UTC) from {username='kudu', principal='kudu/127.7.252.62@KRBTEST.COM'} at 127.0.0.1:58186
I20260807 00:39:07.705924 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28294
I20260807 00:39:07.706983 28751 ts_tablet_manager.cc:1905] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:07.709827 28751 ts_tablet_manager.cc:1918] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:07.709965 28751 log.cc:1196] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/54bd36c748244d1b8d9a4094d362d99b
I20260807 00:39:07.710302 28751 ts_tablet_manager.cc:1939] T 54bd36c748244d1b8d9a4094d362d99b P 689e8f860639493da8d358f4ad2ba98e: Deleting consensus metadata
I20260807 00:39:07.710841 28753 tablet_replica.cc:330] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: stopping tablet replica
I20260807 00:39:07.710989 28753 raft_consensus.cc:2229] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:39:07.711031 28214 catalog_manager.cc:4841] TS 689e8f860639493da8d358f4ad2ba98e (127.7.252.2:38467): tablet 54bd36c748244d1b8d9a4094d362d99b (table test-table [id=902c09175d3049d8a55509ea180a491c]) successfully deleted
I20260807 00:39:07.711125 28753 raft_consensus.cc:2258] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:07.711751 28753 ts_tablet_manager.cc:1905] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:07.714097 28753 ts_tablet_manager.cc:1918] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:07.714197 28753 log.cc:1196] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/54bd36c748244d1b8d9a4094d362d99b
I20260807 00:39:07.714541 28753 ts_tablet_manager.cc:1939] T 54bd36c748244d1b8d9a4094d362d99b P 78e0f37f3cd442e8a6508f9271815e71: Deleting consensus metadata
W20260807 00:39:07.714581 28214 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:42211 (error 108)
I20260807 00:39:07.715065 28217 catalog_manager.cc:4841] TS 78e0f37f3cd442e8a6508f9271815e71 (127.7.252.3:43575): tablet 54bd36c748244d1b8d9a4094d362d99b (table test-table [id=902c09175d3049d8a55509ea180a491c]) successfully deleted
I20260807 00:39:07.715270 28721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.715104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42211 (local address 127.0.0.1:60536)
0807 00:39:07.715178 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:07.715228 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 00:39:07.715476 28214 catalog_manager.cc:4584] TS 9b069e57b9ad4a1a9b6619cd01aae8ab (127.7.252.1:42211): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 54bd36c748244d1b8d9a4094d362d99b: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42211: connect: Connection refused (error 111)
I20260807 00:39:07.715667 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28437
I20260807 00:39:07.723367 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28574
I20260807 00:39:07.729977 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28197
2026-08-07T00:39:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2124 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T00:39:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:07Z Disabled control of system clock
I20260807 00:39:07.763677 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:43027
--webserver_interface=127.7.252.62
--webserver_port=0
--builtin_ntp_servers=127.7.252.20:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:43027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:07.854449 28759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:07.854753 28759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:07.854794 28759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:07.856003 28759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:07.856048 28759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:07.856061 28759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:07.856082 28759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:07.856094 28759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:07.857412 28759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:43027
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:43027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:07.857630 28759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:07.857880 28759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:07.863073 28767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:07.863147 28765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:07.863083 28764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:07.863409 28759 server_base.cc:1034] running on GCE node
I20260807 00:39:07.863727 28759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:07.864089 28759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:07.865309 28759 hybrid_clock.cc:648] HybridClock initialized: now 1786063147865253 us; error 65 us; skew 500 ppm
I20260807 00:39:07.866879 28759 webserver.cc:460] Webserver started at http://127.7.252.62:45965/ using document root <none> and password file <none>
I20260807 00:39:07.867144 28759 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:07.867221 28759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:07.867378 28759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:07.868585 28759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "bb0418f447ae4008af3ced8c170420dd"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "419e5f09a3d70bce5d421f9eec96d1e3"
server_key_iv: "a896701d3ab48a73b97e1da93d5c0abf"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.868974 28759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "bb0418f447ae4008af3ced8c170420dd"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "419e5f09a3d70bce5d421f9eec96d1e3"
server_key_iv: "a896701d3ab48a73b97e1da93d5c0abf"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.870299 28759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:07.871146 28773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.871320 28759 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:07.871436 28759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "bb0418f447ae4008af3ced8c170420dd"
format_stamp: "Formatted at 2026-08-07 00:39:07 on dist-test-slave-csg5"
server_key: "419e5f09a3d70bce5d421f9eec96d1e3"
server_key_iv: "a896701d3ab48a73b97e1da93d5c0abf"
server_key_version: "encryptionkey@0"
I20260807 00:39:07.871515 28759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:07.896028 28759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:07.896435 28759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:07.896615 28759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:07.901304 28759 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:43027
I20260807 00:39:07.901469 28828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:43027 every 8 connection(s)
I20260807 00:39:07.901794 28759 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:07.903133 28829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:07.906076 28829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd: Bootstrap starting.
I20260807 00:39:07.906847 28829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:07.907217 28829 log.cc:824] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:07.908090 28829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd: No bootstrap required, opened a new log
I20260807 00:39:07.909485 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28759
I20260807 00:39:07.909642 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:07.909942 8176 external_mini_cluster.cc:1428] Setting key 6bb4752389fd21e4776835b4c6bcfbc9
I20260807 00:39:07.910794 28829 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0418f447ae4008af3ced8c170420dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43027 } }
I20260807 00:39:07.911010 28829 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:07.911042 28829 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb0418f447ae4008af3ced8c170420dd, State: Initialized, Role: FOLLOWER
I20260807 00:39:07.911214 28829 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0418f447ae4008af3ced8c170420dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43027 } }
I20260807 00:39:07.911306 28829 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:07.911355 28829 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:07.911422 28829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:07.912304 28829 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0418f447ae4008af3ced8c170420dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43027 } }
I20260807 00:39:07.912454 28829 leader_election.cc:302] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb0418f447ae4008af3ced8c170420dd; no voters:
I20260807 00:39:07.912639 28829 leader_election.cc:288] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:07.912674 28834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:07.912783 28834 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [term 1 LEADER]: Becoming Leader. State: Replica: bb0418f447ae4008af3ced8c170420dd, State: Running, Role: LEADER
I20260807 00:39:07.912967 28829 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:07.912930 28834 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0418f447ae4008af3ced8c170420dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43027 } }
I20260807 00:39:07.913482 28834 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb0418f447ae4008af3ced8c170420dd. Latest consensus state: current_term: 1 leader_uuid: "bb0418f447ae4008af3ced8c170420dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0418f447ae4008af3ced8c170420dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43027 } } }
I20260807 00:39:07.913754 28834 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:07.913676 28835 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb0418f447ae4008af3ced8c170420dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0418f447ae4008af3ced8c170420dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 43027 } } }
I20260807 00:39:07.914211 28835 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:07.914417 28843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:07.915273 28843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:07.917057 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:07.910708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44682 (local address 127.7.252.62:43027)
0807 00:39:07.910952 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:07.910960 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:07.910988 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:39:07.911160 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:07.911188 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:07.911283 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:07.911471 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:07.911824 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.913560 (+ 1736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.914777 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:07.915244 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:07.915403 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:07.916223 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:07.916227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:07.916227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:07.916467 (+ 240us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:07.916510 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:07.916524 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:07.916610 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:07.916726 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 00:39:07.916816 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260807 00:39:07.919070 28843 catalog_manager.cc:1347] Generated new cluster ID: 8a5b6cb752ce4a05afcdf359ad6255b0
I20260807 00:39:07.919178 28843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:07.945253 28843 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:07.945879 28843 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:07.953058 28843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd: Generated new TSK 0
I20260807 00:39:07.953392 28843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:07.963006 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.1:0
--local_ip_for_outbound_sockets=127.7.252.1
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43027
--builtin_ntp_servers=127.7.252.20:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 00:39:08.055051 28853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:08.055274 28853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:08.055299 28853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:08.056536 28853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:08.056583 28853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:08.056609 28853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.1
I20260807 00:39:08.058043 28853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.252.1
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.1
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:08.058312 28853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:08.058638 28853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:08.064113 28861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:08.064113 28859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:08.064146 28858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:08.064481 28853 server_base.cc:1034] running on GCE node
I20260807 00:39:08.064713 28853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:08.064924 28853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:08.066145 28853 hybrid_clock.cc:648] HybridClock initialized: now 1786063148066127 us; error 39 us; skew 500 ppm
I20260807 00:39:08.067771 28853 webserver.cc:460] Webserver started at http://127.7.252.1:45393/ using document root <none> and password file <none>
I20260807 00:39:08.068045 28853 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:08.068128 28853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:08.068293 28853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:08.069423 28853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data/instance:
uuid: "40f33da17a4d44c589b5ed942d8de4fb"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "8481836a1cea5622084be02e9150e4be"
server_key_iv: "775cfe4c6ed44eb70e1c3c441091da3b"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.069850 28853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance:
uuid: "40f33da17a4d44c589b5ed942d8de4fb"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "8481836a1cea5622084be02e9150e4be"
server_key_iv: "775cfe4c6ed44eb70e1c3c441091da3b"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.071348 28853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 00:39:08.072166 28867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.072374 28853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:08.072470 28853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal
uuid: "40f33da17a4d44c589b5ed942d8de4fb"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "8481836a1cea5622084be02e9150e4be"
server_key_iv: "775cfe4c6ed44eb70e1c3c441091da3b"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.072557 28853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:08.090178 28853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:08.090543 28853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:08.090773 28853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:08.091046 28853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:08.091398 28853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:08.091454 28853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.091495 28853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:08.091542 28853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.097365 28853 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.1:42719
I20260807 00:39:08.097416 28987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.1:42719 every 8 connection(s)
I20260807 00:39:08.097801 28853 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/data/info.pb
I20260807 00:39:08.100169 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28853
I20260807 00:39:08.100297 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-0/wal/instance
I20260807 00:39:08.100493 8176 external_mini_cluster.cc:1428] Setting key aeaba94036c07c082261ca04bb7ace94
I20260807 00:39:08.101514 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.2:0
--local_ip_for_outbound_sockets=127.7.252.2
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43027
--builtin_ntp_servers=127.7.252.20:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 00:39:08.103643 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.098678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.1:49899 (local address 127.7.252.62:43027)
0807 00:39:08.098789 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.098791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.098993 (+ 202us) server_negotiation.cc:407] Connection header received
0807 00:39:08.099560 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.099562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.099579 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.099634 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:08.100422 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.100943 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.102063 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.102265 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.102347 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.103371 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:08.103373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:08.103373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:08.103377 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:08.103393 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:08.103397 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:08.103446 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.103553 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.103583 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 00:39:08.103938 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.098580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43027 (local address 127.7.252.1:49899)
0807 00:39:08.098853 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.098902 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.099441 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.099706 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.099710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.099720 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:08.100261 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.100266 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.101050 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.101051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.101964 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.101966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.102358 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.102359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.102497 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.103149 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:08.103150 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:08.103196 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:08.103230 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:08.103466 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:08.103473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:08.103476 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.103552 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.103673 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":118,"threads_started":1}
I20260807 00:39:08.104538 28988 heartbeater.cc:347] Connected to a master server at 127.7.252.62:43027
I20260807 00:39:08.104632 28988 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:08.104882 28988 heartbeater.cc:511] Master 127.7.252.62:43027 requested a full tablet report, sending...
I20260807 00:39:08.105476 28790 ts_manager.cc:194] Registered new tserver with Master: 40f33da17a4d44c589b5ed942d8de4fb (127.7.252.1:42719)
I20260807 00:39:08.106137 28790 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.1:49899
W20260807 00:39:08.188122 28991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:08.188643 28991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:08.188761 28991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:08.190279 28991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:08.190330 28991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:08.190373 28991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.2
I20260807 00:39:08.192273 28991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.252.2
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.2
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:08.192602 28991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:08.192952 28991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:08.198491 28997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:08.198613 28999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:08.198632 28996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:08.198942 28991 server_base.cc:1034] running on GCE node
I20260807 00:39:08.199191 28991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:08.199622 28991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:08.200811 28991 hybrid_clock.cc:648] HybridClock initialized: now 1786063148200782 us; error 57 us; skew 500 ppm
I20260807 00:39:08.202521 28991 webserver.cc:460] Webserver started at http://127.7.252.2:34991/ using document root <none> and password file <none>
I20260807 00:39:08.202903 28991 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:08.202966 28991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:08.203125 28991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:08.204380 28991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data/instance:
uuid: "869a6120d4e34013ac7a4059fa1e0788"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "1f30b6a30fc14f9e7ff1f13a3b6b03c4"
server_key_iv: "23b2ef4fe549ab6dd9bd05787622316f"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.204803 28991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance:
uuid: "869a6120d4e34013ac7a4059fa1e0788"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "1f30b6a30fc14f9e7ff1f13a3b6b03c4"
server_key_iv: "23b2ef4fe549ab6dd9bd05787622316f"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.206569 28991 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 00:39:08.207767 29005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.208014 28991 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:08.208140 28991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal
uuid: "869a6120d4e34013ac7a4059fa1e0788"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "1f30b6a30fc14f9e7ff1f13a3b6b03c4"
server_key_iv: "23b2ef4fe549ab6dd9bd05787622316f"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.208328 28991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:08.258738 28991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:08.259189 28991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:08.259382 28991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:08.259694 28991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:08.260087 28991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:08.260128 28991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.260152 28991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:08.260196 28991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.266779 28991 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.2:42379
I20260807 00:39:08.266834 29121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.2:42379 every 8 connection(s)
I20260807 00:39:08.267261 28991 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/data/info.pb
I20260807 00:39:08.269232 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 28991
I20260807 00:39:08.269366 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal/instance
I20260807 00:39:08.269590 8176 external_mini_cluster.cc:1428] Setting key 351a9c8925eb65b455dbdb10114129ee
I20260807 00:39:08.271018 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.252.3:0
--local_ip_for_outbound_sockets=127.7.252.3
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43027
--builtin_ntp_servers=127.7.252.20:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 00:39:08.274124 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.268205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:53963 (local address 127.7.252.62:43027)
0807 00:39:08.268310 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.268313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.268692 (+ 379us) server_negotiation.cc:407] Connection header received
0807 00:39:08.269356 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.269359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.269375 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.269458 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:08.270413 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.271138 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.272367 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.272589 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.272670 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.273723 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:08.273724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:08.273725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:08.273731 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:08.273748 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:08.273756 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:08.273863 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.273993 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.274030 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 00:39:08.274681 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.268145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43027 (local address 127.7.252.2:53963)
0807 00:39:08.268523 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.268565 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.269070 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.269577 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.269581 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.269590 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:08.270301 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.270308 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.271410 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.271411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.272247 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.272249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.272687 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.272688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.272833 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.273510 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:08.273511 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:08.273543 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:08.273582 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:08.273864 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:08.273873 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:08.273877 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.273978 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.274116 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":116,"threads_started":1}
I20260807 00:39:08.275640 29122 heartbeater.cc:347] Connected to a master server at 127.7.252.62:43027
I20260807 00:39:08.275810 29122 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:08.276036 29122 heartbeater.cc:511] Master 127.7.252.62:43027 requested a full tablet report, sending...
I20260807 00:39:08.276597 28790 ts_manager.cc:194] Registered new tserver with Master: 869a6120d4e34013ac7a4059fa1e0788 (127.7.252.2:42379)
I20260807 00:39:08.277299 28790 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.2:53963
W20260807 00:39:08.366739 29125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:08.367137 29125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:08.367172 29125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:08.368683 29125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:08.368743 29125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:08.368773 29125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.252.3
I20260807 00:39:08.370393 29125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.252.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.252.3
--webserver_port=0
--tserver_master_addrs=127.7.252.62:43027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.252.3
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:08.370755 29125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:08.371182 29125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:08.377745 29131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:08.377755 29133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:08.377755 29130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:08.378032 29125 server_base.cc:1034] running on GCE node
I20260807 00:39:08.378382 29125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:08.378751 29125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:08.379945 29125 hybrid_clock.cc:648] HybridClock initialized: now 1786063148379920 us; error 44 us; skew 500 ppm
I20260807 00:39:08.381611 29125 webserver.cc:460] Webserver started at http://127.7.252.3:36435/ using document root <none> and password file <none>
I20260807 00:39:08.381935 29125 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:08.382020 29125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:08.382201 29125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:08.383473 29125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data/instance:
uuid: "018e2bb68bbb4293bab0ec3f85b01bea"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "304d4a363836aac5466b655fa65178ef"
server_key_iv: "b30ccbc6f42124a8a8321629f7333ebf"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.383888 29125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance:
uuid: "018e2bb68bbb4293bab0ec3f85b01bea"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "304d4a363836aac5466b655fa65178ef"
server_key_iv: "b30ccbc6f42124a8a8321629f7333ebf"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.385592 29125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:39:08.386651 29139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.386948 29125 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:08.387094 29125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal
uuid: "018e2bb68bbb4293bab0ec3f85b01bea"
format_stamp: "Formatted at 2026-08-07 00:39:08 on dist-test-slave-csg5"
server_key: "304d4a363836aac5466b655fa65178ef"
server_key_iv: "b30ccbc6f42124a8a8321629f7333ebf"
server_key_version: "encryptionkey@0"
I20260807 00:39:08.387326 29125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:08.407023 29125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:08.407431 29125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:08.407598 29125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:08.407898 29125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 00:39:08.408344 29125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 00:39:08.408404 29125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.408457 29125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 00:39:08.408489 29125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:08.415644 29125 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.3:45499
I20260807 00:39:08.415763 29256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.3:45499 every 8 connection(s)
I20260807 00:39:08.416105 29125 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/data/info.pb
I20260807 00:39:08.418777 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29125
I20260807 00:39:08.418902 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal/instance
I20260807 00:39:08.419109 8176 external_mini_cluster.cc:1428] Setting key 1a67601c121c80ef6c414f758c7b52c5
I20260807 00:39:08.422310 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.416974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.3:47571 (local address 127.7.252.62:43027)
0807 00:39:08.417053 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.417055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.417386 (+ 331us) server_negotiation.cc:407] Connection header received
0807 00:39:08.417902 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.417903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.417916 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.417972 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:08.418830 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.419542 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.420699 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.420943 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.421035 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.422000 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:08.422002 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:08.422002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:08.422008 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:08.422025 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:08.422029 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:08.422084 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.422185 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.422222 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 00:39:08.422585 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.416995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:43027 (local address 127.7.252.3:47571)
0807 00:39:08.417224 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.417262 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.417799 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.418032 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.418035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.418044 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:08.418714 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.418722 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.419646 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.419647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.420593 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.420596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.421055 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.421056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.421197 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.421829 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 00:39:08.421829 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:08.421860 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 00:39:08.421885 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:08.422090 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:08.422096 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:08.422099 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.422190 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.422310 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":119,"threads_started":1}
I20260807 00:39:08.423067 29257 heartbeater.cc:347] Connected to a master server at 127.7.252.62:43027
I20260807 00:39:08.423167 29257 heartbeater.cc:464] Registering TS with master...
I20260807 00:39:08.423362 29257 heartbeater.cc:511] Master 127.7.252.62:43027 requested a full tablet report, sending...
I20260807 00:39:08.423758 28790 ts_manager.cc:194] Registered new tserver with Master: 018e2bb68bbb4293bab0ec3f85b01bea (127.7.252.3:45499)
I20260807 00:39:08.424141 28790 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.252.3:47571
I20260807 00:39:08.431649 8176 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 00:39:08.436517 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.433116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44686 (local address 127.7.252.62:43027)
0807 00:39:08.433207 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.433209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.433250 (+ 41us) server_negotiation.cc:407] Connection header received
0807 00:39:08.433301 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.433302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.433317 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.433368 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:08.433564 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.434067 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.435025 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.435224 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.435330 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.436088 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:08.436089 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:08.436090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:08.436095 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:08.436110 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:08.436114 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:08.436160 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.436386 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.436424 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 00:39:08.438797 28790 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 00:39:08.440541 28790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 00:39:08.447899 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.443413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:45499 (local address 127.0.0.1:56188)
0807 00:39:08.443723 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.443735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.443787 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.444114 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.444115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.444118 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:08.444183 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.444185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.445292 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.445293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.446840 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.446843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.447601 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.447602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.447665 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.447684 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.447736 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.447796 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":8,"thread_start_us":41,"threads_started":1}
I20260807 00:39:08.447995 29269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.443398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50846 (local address 127.7.252.2:42379)
0807 00:39:08.443671 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.443678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.443689 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:39:08.443734 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.443736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.443753 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.443838 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:08.444130 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.445348 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.446708 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.447443 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.447544 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.447646 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.447853 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.447899 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":98,"threads_started":1}
I20260807 00:39:08.448069 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.443200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42719 (local address 127.0.0.1:50436)
0807 00:39:08.443512 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.443522 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.443572 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.443927 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.443931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.443933 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:08.444047 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.444048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.445478 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.445479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.446840 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.446843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.447794 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.447795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.447861 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.447866 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.447920 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.447966 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":179,"thread_start_us":80,"threads_started":1}
I20260807 00:39:08.448231 29267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.443167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.2:42379 (local address 127.0.0.1:50846)
0807 00:39:08.443382 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.443428 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.443504 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.443948 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.443949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.443950 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:08.444035 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.444038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.445490 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.445491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.446588 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.446591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.447573 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.447575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.447665 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.447684 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.447766 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.447797 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":85,"thread_start_us":75,"threads_started":1}
I20260807 00:39:08.448557 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.443407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50436 (local address 127.7.252.1:42719)
0807 00:39:08.443701 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.443705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.443713 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:39:08.443751 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.443753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.443766 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.443845 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:08.444128 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.445349 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.446945 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.447702 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.447791 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.447887 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.447944 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.448451 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":114,"threads_started":1}
I20260807 00:39:08.448575 29271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.443756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56188 (local address 127.7.252.3:45499)
0807 00:39:08.443931 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.443936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.443947 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:39:08.443991 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.443992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.444008 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.444332 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:08.444400 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.445121 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.446954 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.447476 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.448137 (+ 661us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.448416 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.448443 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.448487 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260807 00:39:08.448989 29055 tablet_service.cc:1467] Processing CreateTablet for tablet 67d21ec340c94baeb55bed1fc72f36fd (DEFAULT_TABLE table=test-table [id=7750cd386c924ad38bcc360d020e4a10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:08.449159 29188 tablet_service.cc:1467] Processing CreateTablet for tablet 67d21ec340c94baeb55bed1fc72f36fd (DEFAULT_TABLE table=test-table [id=7750cd386c924ad38bcc360d020e4a10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:08.449189 28918 tablet_service.cc:1467] Processing CreateTablet for tablet 67d21ec340c94baeb55bed1fc72f36fd (DEFAULT_TABLE table=test-table [id=7750cd386c924ad38bcc360d020e4a10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 00:39:08.449381 29055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67d21ec340c94baeb55bed1fc72f36fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:08.449450 29188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67d21ec340c94baeb55bed1fc72f36fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:08.449460 28918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67d21ec340c94baeb55bed1fc72f36fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:08.452502 29272 tablet_bootstrap.cc:492] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: Bootstrap starting.
I20260807 00:39:08.452807 29274 tablet_bootstrap.cc:492] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Bootstrap starting.
I20260807 00:39:08.453274 29272 tablet_bootstrap.cc:654] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:08.453500 29274 tablet_bootstrap.cc:654] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:08.453619 29272 log.cc:824] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:08.453830 29274 log.cc:824] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:08.454190 29273 tablet_bootstrap.cc:492] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Bootstrap starting.
I20260807 00:39:08.454583 29272 tablet_bootstrap.cc:492] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: No bootstrap required, opened a new log
I20260807 00:39:08.454713 29272 ts_tablet_manager.cc:1397] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:08.454808 29273 tablet_bootstrap.cc:654] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:08.455138 29273 log.cc:824] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:08.455299 29274 tablet_bootstrap.cc:492] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: No bootstrap required, opened a new log
I20260807 00:39:08.455376 29274 ts_tablet_manager.cc:1397] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 00:39:08.457007 29272 raft_consensus.cc:348] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.457203 29272 raft_consensus.cc:374] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:08.457260 29272 raft_consensus.cc:729] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f33da17a4d44c589b5ed942d8de4fb, State: Initialized, Role: FOLLOWER
I20260807 00:39:08.457170 29274 raft_consensus.cc:348] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.457382 29274 raft_consensus.cc:374] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:08.457430 29274 raft_consensus.cc:729] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 869a6120d4e34013ac7a4059fa1e0788, State: Initialized, Role: FOLLOWER
I20260807 00:39:08.457396 29272 consensus_queue.cc:260] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.457569 29274 consensus_queue.cc:260] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.457721 29272 ts_tablet_manager.cc:1428] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 00:39:08.457896 29274 ts_tablet_manager.cc:1428] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 00:39:08.457908 28988 heartbeater.cc:503] Master 127.7.252.62:43027 was elected leader, sending a full tablet report...
I20260807 00:39:08.457978 29273 tablet_bootstrap.cc:492] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: No bootstrap required, opened a new log
I20260807 00:39:08.458022 29122 heartbeater.cc:503] Master 127.7.252.62:43027 was elected leader, sending a full tablet report...
I20260807 00:39:08.458047 29273 ts_tablet_manager.cc:1397] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260807 00:39:08.460506 29273 raft_consensus.cc:348] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.460711 29273 raft_consensus.cc:374] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:08.460753 29273 raft_consensus.cc:729] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018e2bb68bbb4293bab0ec3f85b01bea, State: Initialized, Role: FOLLOWER
I20260807 00:39:08.460875 29273 consensus_queue.cc:260] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.461119 29273 ts_tablet_manager.cc:1428] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 00:39:08.461199 29257 heartbeater.cc:503] Master 127.7.252.62:43027 was elected leader, sending a full tablet report...
W20260807 00:39:08.517942 29123 tablet.cc:2369] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:08.520007 29279 raft_consensus.cc:482] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 00:39:08.520110 29279 raft_consensus.cc:504] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.520628 29279 leader_election.cc:288] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018e2bb68bbb4293bab0ec3f85b01bea (127.7.252.3:45499), 40f33da17a4d44c589b5ed942d8de4fb (127.7.252.1:42719)
I20260807 00:39:08.525264 29271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.520974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:46081 (local address 127.7.252.3:45499)
0807 00:39:08.521029 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.521031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.521040 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:08.521087 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.521087 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.521096 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.521187 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:08.521485 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.522268 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.524074 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.524714 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.524831 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.524846 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.525113 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.525175 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 00:39:08.525277 29281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.520864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42719 (local address 127.7.252.2:58761)
0807 00:39:08.521056 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.521065 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.521128 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.521334 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.521335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.521337 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:08.521430 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.521432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.522436 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.522438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.523921 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.523925 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.524931 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.524932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.524998 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.525003 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.525075 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.525165 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":110,"thread_start_us":119,"threads_started":1}
I20260807 00:39:08.525264 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.520974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.252.2:58761 (local address 127.7.252.1:42719)
0807 00:39:08.521024 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.521026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.521138 (+ 112us) server_negotiation.cc:407] Connection header received
0807 00:39:08.521168 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.521169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.521249 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.521305 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 00:39:08.521513 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.522320 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.524073 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.524803 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.524890 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.524901 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.525113 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.525174 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 00:39:08.525399 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.520853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.3:45499 (local address 127.7.252.2:46081)
0807 00:39:08.520922 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.520935 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:08.520980 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:08.521220 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:08.521221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:08.521222 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 00:39:08.521374 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.521377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.522438 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.522439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.523921 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:08.523925 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.524903 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.524904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:08.524998 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.525002 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 00:39:08.525075 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 00:39:08.525166 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":142}
I20260807 00:39:08.525722 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67d21ec340c94baeb55bed1fc72f36fd" candidate_uuid: "869a6120d4e34013ac7a4059fa1e0788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f33da17a4d44c589b5ed942d8de4fb" is_pre_election: true
I20260807 00:39:08.525738 29209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67d21ec340c94baeb55bed1fc72f36fd" candidate_uuid: "869a6120d4e34013ac7a4059fa1e0788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" is_pre_election: true
I20260807 00:39:08.525899 29209 raft_consensus.cc:2454] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 869a6120d4e34013ac7a4059fa1e0788 in term 0.
I20260807 00:39:08.525928 28938 raft_consensus.cc:2454] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 869a6120d4e34013ac7a4059fa1e0788 in term 0.
I20260807 00:39:08.526192 29009 leader_election.cc:302] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40f33da17a4d44c589b5ed942d8de4fb, 869a6120d4e34013ac7a4059fa1e0788; no voters:
I20260807 00:39:08.526351 29279 raft_consensus.cc:2781] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 00:39:08.526414 29279 raft_consensus.cc:482] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 00:39:08.526432 29279 raft_consensus.cc:3037] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:08.527354 29279 raft_consensus.cc:504] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.527591 29279 leader_election.cc:288] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [CANDIDATE]: Term 1 election: Requested vote from peers 018e2bb68bbb4293bab0ec3f85b01bea (127.7.252.3:45499), 40f33da17a4d44c589b5ed942d8de4fb (127.7.252.1:42719)
I20260807 00:39:08.527742 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67d21ec340c94baeb55bed1fc72f36fd" candidate_uuid: "869a6120d4e34013ac7a4059fa1e0788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f33da17a4d44c589b5ed942d8de4fb"
I20260807 00:39:08.527839 28938 raft_consensus.cc:3037] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:08.527868 29209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67d21ec340c94baeb55bed1fc72f36fd" candidate_uuid: "869a6120d4e34013ac7a4059fa1e0788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018e2bb68bbb4293bab0ec3f85b01bea"
I20260807 00:39:08.527961 29209 raft_consensus.cc:3037] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:08.528674 28938 raft_consensus.cc:2454] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 869a6120d4e34013ac7a4059fa1e0788 in term 1.
I20260807 00:39:08.528815 29209 raft_consensus.cc:2454] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 869a6120d4e34013ac7a4059fa1e0788 in term 1.
I20260807 00:39:08.528869 29009 leader_election.cc:302] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40f33da17a4d44c589b5ed942d8de4fb, 869a6120d4e34013ac7a4059fa1e0788; no voters:
I20260807 00:39:08.529031 29279 raft_consensus.cc:2781] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:08.529178 29279 raft_consensus.cc:686] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 1 LEADER]: Becoming Leader. State: Replica: 869a6120d4e34013ac7a4059fa1e0788, State: Running, Role: LEADER
I20260807 00:39:08.529420 29279 consensus_queue.cc:237] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } }
I20260807 00:39:08.530390 28790 catalog_manager.cc:5495] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 reported cstate change: term changed from 0 to 1, leader changed from <none> to 869a6120d4e34013ac7a4059fa1e0788 (127.7.252.2). New cstate: current_term: 1 leader_uuid: "869a6120d4e34013ac7a4059fa1e0788" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "869a6120d4e34013ac7a4059fa1e0788" member_type: VOTER last_known_addr { host: "127.7.252.2" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 } health_report { overall_health: UNKNOWN } } }
I20260807 00:39:08.541944 29269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.539146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50850 (local address 127.7.252.2:42379)
0807 00:39:08.539190 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:08.539192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:08.539201 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:08.539279 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:08.539279 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:08.539300 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:08.539371 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:08.539499 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.539962 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.540902 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:08.541099 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:08.541302 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:08.541515 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:08.541626 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:08.541708 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:08.541755 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 00:39:08.541784 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:39:08.544294 29209 raft_consensus.cc:1261] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 1 FOLLOWER]: Refusing update from remote peer 869a6120d4e34013ac7a4059fa1e0788: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:08.544365 28938 raft_consensus.cc:1261] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 1 FOLLOWER]: Refusing update from remote peer 869a6120d4e34013ac7a4059fa1e0788: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:08.544754 29282 consensus_queue.cc:1035] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018e2bb68bbb4293bab0ec3f85b01bea" member_type: VOTER last_known_addr { host: "127.7.252.3" port: 45499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:08.544934 29279 consensus_queue.cc:1035] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f33da17a4d44c589b5ed942d8de4fb" member_type: VOTER last_known_addr { host: "127.7.252.1" port: 42719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:08.547421 29285 mvcc.cc:205] Tried to move back new op lower bound from 7315714656434216960 to 7315714656377249792. Current Snapshot: MvccSnapshot[applied={T|T < 7315714656434216960}]
I20260807 00:39:08.547813 29287 mvcc.cc:205] Tried to move back new op lower bound from 7315714656434216960 to 7315714656377249792. Current Snapshot: MvccSnapshot[applied={T|T < 7315714656434216960}]
I20260807 00:39:08.548329 29286 mvcc.cc:205] Tried to move back new op lower bound from 7315714656434216960 to 7315714656377249792. Current Snapshot: MvccSnapshot[applied={T|T < 7315714656434216960}]
I20260807 00:39:08.549908 28789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:08.550022 28789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 00:39:08.550896 28789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb0418f447ae4008af3ced8c170420dd: Sending DeleteTablet for 3 replicas of tablet 67d21ec340c94baeb55bed1fc72f36fd
I20260807 00:39:08.551316 28918 tablet_service.cc:1514] Processing DeleteTablet for tablet 67d21ec340c94baeb55bed1fc72f36fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:08 UTC) from {username='slave'} at 127.0.0.1:50436
I20260807 00:39:08.551455 29188 tablet_service.cc:1514] Processing DeleteTablet for tablet 67d21ec340c94baeb55bed1fc72f36fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:08 UTC) from {username='slave'} at 127.0.0.1:56188
I20260807 00:39:08.551502 29055 tablet_service.cc:1514] Processing DeleteTablet for tablet 67d21ec340c94baeb55bed1fc72f36fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 00:39:08 UTC) from {username='slave'} at 127.0.0.1:50846
I20260807 00:39:08.551592 29295 tablet_replica.cc:330] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb: stopping tablet replica
I20260807 00:39:08.551695 29295 raft_consensus.cc:2229] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:08.551862 29295 raft_consensus.cc:2258] T 67d21ec340c94baeb55bed1fc72f36fd P 40f33da17a4d44c589b5ed942d8de4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:08.551935 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28853
I20260807 00:39:08.552608 29296 tablet_replica.cc:330] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: stopping tablet replica
I20260807 00:39:08.552739 29296 raft_consensus.cc:2229] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 00:39:08.552861 29296 raft_consensus.cc:2258] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:08.553102 29297 tablet_replica.cc:330] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: stopping tablet replica
I20260807 00:39:08.553197 29297 raft_consensus.cc:2229] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 1 LEADER]: Raft consensus shutting down.
I20260807 00:39:08.553336 29297 raft_consensus.cc:2258] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 00:39:08.553725 29296 ts_tablet_manager.cc:1905] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:08.553747 29297 ts_tablet_manager.cc:1905] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 00:39:08.555912 29296 ts_tablet_manager.cc:1918] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:08.555954 29297 ts_tablet_manager.cc:1918] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 00:39:08.556030 29297 log.cc:1196] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-1/wal/wals/67d21ec340c94baeb55bed1fc72f36fd
I20260807 00:39:08.556146 29296 log.cc:1196] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Deleting WAL directory at /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786062890064039-8176-0/minicluster-data/ts-2/wal/wals/67d21ec340c94baeb55bed1fc72f36fd
I20260807 00:39:08.556370 29297 ts_tablet_manager.cc:1939] T 67d21ec340c94baeb55bed1fc72f36fd P 869a6120d4e34013ac7a4059fa1e0788: Deleting consensus metadata
I20260807 00:39:08.556653 29296 ts_tablet_manager.cc:1939] T 67d21ec340c94baeb55bed1fc72f36fd P 018e2bb68bbb4293bab0ec3f85b01bea: Deleting consensus metadata
I20260807 00:39:08.556926 28776 catalog_manager.cc:4841] TS 869a6120d4e34013ac7a4059fa1e0788 (127.7.252.2:42379): tablet 67d21ec340c94baeb55bed1fc72f36fd (table test-table [id=7750cd386c924ad38bcc360d020e4a10]) successfully deleted
I20260807 00:39:08.557271 28776 catalog_manager.cc:4841] TS 018e2bb68bbb4293bab0ec3f85b01bea (127.7.252.3:45499): tablet 67d21ec340c94baeb55bed1fc72f36fd (table test-table [id=7750cd386c924ad38bcc360d020e4a10]) successfully deleted
W20260807 00:39:08.562628 28777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.252.1:42719 (error 108)
I20260807 00:39:08.563311 29267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:08.563138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.1:42719 (local address 127.0.0.1:50450)
0807 00:39:08.563207 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:08.563262 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 00:39:08.563369 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28991
W20260807 00:39:08.566246 28777 catalog_manager.cc:4584] TS 40f33da17a4d44c589b5ed942d8de4fb (127.7.252.1:42719): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 67d21ec340c94baeb55bed1fc72f36fd: Network error: Client connection negotiation failed: client connection to 127.7.252.1:42719: connect: Connection refused (error 111)
I20260807 00:39:08.570804 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29125
I20260807 00:39:08.577570 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 28759
2026-08-07T00:39:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (845 ms)
[----------] 6 tests from EncryptionPolicyTest (9684 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:08 dist-test-slave-csg5 krb5kdc[29301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:08 dist-test-slave-csg5 krb5kdc[29301](info): set up 2 sockets
Aug 07 00:39:08 dist-test-slave-csg5 krb5kdc[29301](info): commencing operation
krb5kdc: starting...
W20260807 00:39:09.700765 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:09 dist-test-slave-csg5 krb5kdc[29301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:09.839411 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40365
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:09.931790 29315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:09.932037 29315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:09.932063 29315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:09.933313 29315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:09.933364 29315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:09.933379 29315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:09.933393 29315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:09.933406 29315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:09.935061 29315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40365
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:09.935354 29315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:09.935613 29315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:09.941138 29321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:09.941133 29323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:09.941134 29320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:09.941169 29315 server_base.cc:1034] running on GCE node
I20260807 00:39:09.941677 29315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:09.942057 29315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:09.943205 29315 hybrid_clock.cc:648] HybridClock initialized: now 1786063149943193 us; error 33 us; skew 500 ppm
Aug 07 00:39:09 dist-test-slave-csg5 krb5kdc[29301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063149, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:09.946149 29315 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:09.946610 29315 webserver.cc:460] Webserver started at http://127.0.0.1:38227/ using document root <none> and password file <none>
I20260807 00:39:09.946872 29315 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:09.946921 29315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:09.947023 29315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:09.948113 29315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "a9889ddc4d89487cb41afc06df454fba"
format_stamp: "Formatted at 2026-08-07 00:39:09 on dist-test-slave-csg5"
server_key: "cc8a2ba4daddd7abe73ba5b1c23ea210"
server_key_iv: "7c34c4666aca16df3b95e43fbfc17873"
server_key_version: "encryptionkey@0"
I20260807 00:39:09.948446 29315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "a9889ddc4d89487cb41afc06df454fba"
format_stamp: "Formatted at 2026-08-07 00:39:09 on dist-test-slave-csg5"
server_key: "cc8a2ba4daddd7abe73ba5b1c23ea210"
server_key_iv: "7c34c4666aca16df3b95e43fbfc17873"
server_key_version: "encryptionkey@0"
I20260807 00:39:09.949867 29315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:09.950646 29330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:09.950868 29315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:09.950966 29315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "a9889ddc4d89487cb41afc06df454fba"
format_stamp: "Formatted at 2026-08-07 00:39:09 on dist-test-slave-csg5"
server_key: "cc8a2ba4daddd7abe73ba5b1c23ea210"
server_key_iv: "7c34c4666aca16df3b95e43fbfc17873"
server_key_version: "encryptionkey@0"
I20260807 00:39:09.951047 29315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:09.962486 29315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:09.965282 29315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:09.965446 29315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:09.970242 29315 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40365
I20260807 00:39:09.970332 29384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40365 every 8 connection(s)
I20260807 00:39:09.970963 29315 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:09.972072 29385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:09.974646 29385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba: Bootstrap starting.
I20260807 00:39:09.975255 29385 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:09.975530 29385 log.cc:824] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:09.976092 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29315
I20260807 00:39:09.976233 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:09.976333 29385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba: No bootstrap required, opened a new log
I20260807 00:39:09.976500 8176 external_mini_cluster.cc:1428] Setting key e6a0018ef0f7fd81cd118f9be814883a
I20260807 00:39:09.979228 29385 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9889ddc4d89487cb41afc06df454fba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40365 } }
I20260807 00:39:09.979415 29385 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:09.979470 29385 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9889ddc4d89487cb41afc06df454fba, State: Initialized, Role: FOLLOWER
I20260807 00:39:09.979619 29385 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9889ddc4d89487cb41afc06df454fba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40365 } }
I20260807 00:39:09.979732 29385 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:09.979784 29385 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:09.979839 29385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:09.980509 29385 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9889ddc4d89487cb41afc06df454fba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40365 } }
I20260807 00:39:09.980655 29385 leader_election.cc:302] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9889ddc4d89487cb41afc06df454fba; no voters:
I20260807 00:39:09.980885 29385 leader_election.cc:288] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:09.980945 29391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:09.981127 29391 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [term 1 LEADER]: Becoming Leader. State: Replica: a9889ddc4d89487cb41afc06df454fba, State: Running, Role: LEADER
I20260807 00:39:09.981185 29385 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:09.981237 29391 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9889ddc4d89487cb41afc06df454fba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40365 } }
I20260807 00:39:09.981595 29392 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9889ddc4d89487cb41afc06df454fba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9889ddc4d89487cb41afc06df454fba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40365 } } }
I20260807 00:39:09.981700 29392 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:09.981968 29393 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9889ddc4d89487cb41afc06df454fba. Latest consensus state: current_term: 1 leader_uuid: "a9889ddc4d89487cb41afc06df454fba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9889ddc4d89487cb41afc06df454fba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40365 } } }
I20260807 00:39:09.982354 29397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:09.982393 29393 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:09.982930 29397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:09.985154 29397 catalog_manager.cc:1347] Generated new cluster ID: 5ff6b7a33f65413aa21307c5406b0157
I20260807 00:39:09.985229 29397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:39:09 dist-test-slave-csg5 krb5kdc[29301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 00:39:09.989732 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:09.977123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46507 (local address 127.0.0.1:40365)
0807 00:39:09.977323 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:09.977331 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:09.977358 (+ 27us) server_negotiation.cc:407] Connection header received
0807 00:39:09.977836 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:09.977843 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:09.977895 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:09.978032 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:09.979078 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:09.980597 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:09.981930 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:09.982803 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:09.982917 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:09.986224 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:09.986229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:09.986229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:09.986246 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:09.988075 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:09.988546 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:09.988555 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:09.988556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:09.988648 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:09.988913 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:09.988914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:09.988914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:09.989180 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:09.989361 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:09.989450 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 00:39:09.989556 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260807 00:39:09.990753 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:09.998356 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:09.992199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60379 (local address 127.0.0.1:40365)
0807 00:39:09.992241 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:09.992243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:09.992307 (+ 64us) server_negotiation.cc:407] Connection header received
0807 00:39:09.992374 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:09.992374 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:09.992385 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:09.992440 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:09.992963 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:09.993470 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:09.994176 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:09.994424 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:09.994500 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:09.995772 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:09.995774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:09.995774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:09.995782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:09.997187 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:09.997549 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:09.997550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:09.997550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:09.997610 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:09.997820 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:09.997821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:09.997821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:09.997936 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:09.998043 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:09.998168 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 00:39:09.998231 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:39:10.003778 29397 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:10.004878 29397 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:10.009758 29397 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9889ddc4d89487cb41afc06df454fba: Generated new TSK 0
I20260807 00:39:10.010129 29397 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:10.016664 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29315
W20260807 00:39:10.023483 29299 connection.cc:535] client connection to 127.0.0.1:40365 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40365): Connection reset by peer (error 104)
2026-08-07T00:39:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1437 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:10 dist-test-slave-csg5 krb5kdc[29418](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:10 dist-test-slave-csg5 krb5kdc[29418](info): set up 2 sockets
Aug 07 00:39:10 dist-test-slave-csg5 krb5kdc[29418](info): commencing operation
krb5kdc: starting...
W20260807 00:39:11.131739 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:11 dist-test-slave-csg5 krb5kdc[29418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:11.273551 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39003
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:11.361289 29432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:11.361560 29432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:11.361601 29432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:11.362843 29432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:11.362918 29432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:11.362943 29432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:11.362975 29432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:11.363003 29432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:11.364589 29432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39003
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:11.364897 29432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:11.365159 29432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:11.370584 29438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:11.370579 29440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:11.370574 29437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:11.370715 29432 server_base.cc:1034] running on GCE node
I20260807 00:39:11.371160 29432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:11.371469 29432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:11.372641 29432 hybrid_clock.cc:648] HybridClock initialized: now 1786063151372623 us; error 43 us; skew 500 ppm
Aug 07 00:39:11 dist-test-slave-csg5 krb5kdc[29418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063151, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:11.380769 29432 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:11.381325 29432 webserver.cc:460] Webserver started at http://127.0.0.1:37263/ using document root <none> and password file <none>
I20260807 00:39:11.381577 29432 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:11.381656 29432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:11.381805 29432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:11.383052 29432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "55e8903899274afba874b74e6607411d"
format_stamp: "Formatted at 2026-08-07 00:39:11 on dist-test-slave-csg5"
server_key: "2bb7a0d1a503282f2ae69ebc439a8935"
server_key_iv: "76428bc2d440e524a38ef974b9923ff1"
server_key_version: "encryptionkey@0"
I20260807 00:39:11.383442 29432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "55e8903899274afba874b74e6607411d"
format_stamp: "Formatted at 2026-08-07 00:39:11 on dist-test-slave-csg5"
server_key: "2bb7a0d1a503282f2ae69ebc439a8935"
server_key_iv: "76428bc2d440e524a38ef974b9923ff1"
server_key_version: "encryptionkey@0"
I20260807 00:39:11.384963 29432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:11.385876 29447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:11.386102 29432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:11.386214 29432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "55e8903899274afba874b74e6607411d"
format_stamp: "Formatted at 2026-08-07 00:39:11 on dist-test-slave-csg5"
server_key: "2bb7a0d1a503282f2ae69ebc439a8935"
server_key_iv: "76428bc2d440e524a38ef974b9923ff1"
server_key_version: "encryptionkey@0"
I20260807 00:39:11.386292 29432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:11.397454 29432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:11.400388 29432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:11.400602 29432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:11.405252 29432 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39003
I20260807 00:39:11.405301 29503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39003 every 8 connection(s)
I20260807 00:39:11.405704 29432 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:11.406948 29504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:11.409530 29504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d: Bootstrap starting.
I20260807 00:39:11.409996 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29432
I20260807 00:39:11.410140 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:11.410259 29504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:11.410349 8176 external_mini_cluster.cc:1428] Setting key 019d8afb8f29020500ccb49669b0a31f
I20260807 00:39:11.410625 29504 log.cc:824] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:11.411620 29504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d: No bootstrap required, opened a new log
I20260807 00:39:11.414225 29504 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e8903899274afba874b74e6607411d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39003 } }
I20260807 00:39:11.414407 29504 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:11.414462 29504 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55e8903899274afba874b74e6607411d, State: Initialized, Role: FOLLOWER
I20260807 00:39:11.414609 29504 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e8903899274afba874b74e6607411d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39003 } }
I20260807 00:39:11.414729 29504 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:11.414775 29504 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:11.414829 29504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:11.415535 29504 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e8903899274afba874b74e6607411d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39003 } }
I20260807 00:39:11.415650 29504 leader_election.cc:302] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55e8903899274afba874b74e6607411d; no voters:
I20260807 00:39:11.415849 29504 leader_election.cc:288] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:11.415917 29509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:11.416074 29509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [term 1 LEADER]: Becoming Leader. State: Replica: 55e8903899274afba874b74e6607411d, State: Running, Role: LEADER
I20260807 00:39:11.416136 29504 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:11.417019 29509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e8903899274afba874b74e6607411d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39003 } }
I20260807 00:39:11.417636 29511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55e8903899274afba874b74e6607411d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e8903899274afba874b74e6607411d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39003 } } }
I20260807 00:39:11.417742 29511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:11.417958 29508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:11.411014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57555 (local address 127.0.0.1:39003)
0807 00:39:11.411233 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:11.411260 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:11.411298 (+ 38us) server_negotiation.cc:407] Connection header received
0807 00:39:11.411960 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:11.411969 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:11.412035 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:11.412200 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:11.412522 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:11.414035 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:11.415263 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:11.415944 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:11.416057 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:11.417018 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:11.417022 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:11.417022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:11.417237 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:11.417280 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:11.417299 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:11.417402 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:11.417518 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 00:39:11.417670 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":110,"threads_started":1}
I20260807 00:39:11.418172 29510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55e8903899274afba874b74e6607411d. Latest consensus state: current_term: 1 leader_uuid: "55e8903899274afba874b74e6607411d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55e8903899274afba874b74e6607411d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39003 } } }
I20260807 00:39:11.418252 29510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d [sys.catalog]: This master's current role is: LEADER
W20260807 00:39:11.418247 29523 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:11.418435 29523 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:11.418751 29524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:11.419005 29524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:11.419062 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:11.420571 29524 catalog_manager.cc:1347] Generated new cluster ID: 2ff84cdf2ee740e7ae6e09b0a15559ad
I20260807 00:39:11.420626 29524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:11.430426 29524 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:11.431064 29508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:11.427387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47205 (local address 127.0.0.1:39003)
0807 00:39:11.427469 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:11.427472 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:11.427717 (+ 245us) server_negotiation.cc:407] Connection header received
0807 00:39:11.427819 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:11.427820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:11.427832 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:11.427894 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:11.428092 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:11.428682 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:11.429518 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:11.429770 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:11.429854 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:11.430764 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:11.430765 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:11.430766 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:11.430772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:11.430798 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:11.430803 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:11.430885 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:11.430958 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 00:39:11.430969 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 00:39:11.431370 29524 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:11.437520 29524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55e8903899274afba874b74e6607411d: Generated new TSK 0
I20260807 00:39:11.437740 29524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:11.442054 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29432
W20260807 00:39:11.448673 29416 connection.cc:535] client connection to 127.0.0.1:39003 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39003): Connection reset by peer (error 104)
2026-08-07T00:39:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:11 dist-test-slave-csg5 krb5kdc[29535](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:11 dist-test-slave-csg5 krb5kdc[29535](info): set up 2 sockets
Aug 07 00:39:11 dist-test-slave-csg5 krb5kdc[29535](info): commencing operation
krb5kdc: starting...
W20260807 00:39:12.537035 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:12 dist-test-slave-csg5 krb5kdc[29535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:12.674844 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35463
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:12.761809 29548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:12.762086 29548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:12.762132 29548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:12.763407 29548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:12.763481 29548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:12.763506 29548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:12.763535 29548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:12.763564 29548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:12.765196 29548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35463
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:12.765522 29548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:12.765785 29548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:12.771291 29556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:12.771318 29554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:12.771425 29553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:12.771451 29548 server_base.cc:1034] running on GCE node
I20260807 00:39:12.771862 29548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:12.772222 29548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:12.773389 29548 hybrid_clock.cc:648] HybridClock initialized: now 1786063152773363 us; error 38 us; skew 500 ppm
Aug 07 00:39:12 dist-test-slave-csg5 krb5kdc[29535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063152, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:12.776312 29548 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:12.776880 29548 webserver.cc:460] Webserver started at http://127.0.0.1:46225/ using document root <none> and password file <none>
I20260807 00:39:12.777122 29548 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:12.777189 29548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:12.777347 29548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:12.778462 29548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "e9153abe0da144a8a840bed223293203"
format_stamp: "Formatted at 2026-08-07 00:39:12 on dist-test-slave-csg5"
server_key: "0b698ddf19386e44041f382dfe367649"
server_key_iv: "a50eebade77231be6183102a37facecb"
server_key_version: "encryptionkey@0"
I20260807 00:39:12.778875 29548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "e9153abe0da144a8a840bed223293203"
format_stamp: "Formatted at 2026-08-07 00:39:12 on dist-test-slave-csg5"
server_key: "0b698ddf19386e44041f382dfe367649"
server_key_iv: "a50eebade77231be6183102a37facecb"
server_key_version: "encryptionkey@0"
I20260807 00:39:12.780460 29548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:12.781436 29563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:12.781661 29548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:12.781780 29548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "e9153abe0da144a8a840bed223293203"
format_stamp: "Formatted at 2026-08-07 00:39:12 on dist-test-slave-csg5"
server_key: "0b698ddf19386e44041f382dfe367649"
server_key_iv: "a50eebade77231be6183102a37facecb"
server_key_version: "encryptionkey@0"
I20260807 00:39:12.781865 29548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:12.785548 29548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:12.788012 29548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:12.788173 29548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:12.792794 29548 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35463
I20260807 00:39:12.792837 29617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35463 every 8 connection(s)
I20260807 00:39:12.793177 29548 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:12.794178 29618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:12.796556 29618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203: Bootstrap starting.
I20260807 00:39:12.797119 29618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:12.797360 29618 log.cc:824] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:12.798077 29618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203: No bootstrap required, opened a new log
I20260807 00:39:12.799753 29618 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9153abe0da144a8a840bed223293203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35463 } }
I20260807 00:39:12.799912 29618 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:12.799935 29618 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9153abe0da144a8a840bed223293203, State: Initialized, Role: FOLLOWER
I20260807 00:39:12.800045 29618 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9153abe0da144a8a840bed223293203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35463 } }
I20260807 00:39:12.800097 29618 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:12.800118 29618 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:12.800155 29618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:12.800709 29618 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9153abe0da144a8a840bed223293203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35463 } }
I20260807 00:39:12.800845 29618 leader_election.cc:302] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9153abe0da144a8a840bed223293203; no voters:
I20260807 00:39:12.800964 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29548
I20260807 00:39:12.801082 29618 leader_election.cc:288] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:12.801105 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:12.801137 29621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:12.801313 29621 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [term 1 LEADER]: Becoming Leader. State: Replica: e9153abe0da144a8a840bed223293203, State: Running, Role: LEADER
I20260807 00:39:12.801383 29618 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:12.801477 8176 external_mini_cluster.cc:1428] Setting key 2143a7f53312446e2e351207d41c5c63
I20260807 00:39:12.801468 29621 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9153abe0da144a8a840bed223293203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35463 } }
I20260807 00:39:12.801792 29621 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9153abe0da144a8a840bed223293203. Latest consensus state: current_term: 1 leader_uuid: "e9153abe0da144a8a840bed223293203" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9153abe0da144a8a840bed223293203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35463 } } }
I20260807 00:39:12.801918 29621 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:12.802208 29627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:12.802089 29623 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9153abe0da144a8a840bed223293203" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9153abe0da144a8a840bed223293203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35463 } } }
I20260807 00:39:12.802395 29623 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:12.803018 29627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:12.804742 29627 catalog_manager.cc:1347] Generated new cluster ID: 82e6e26834c4404ba270b6d33891c9e6
I20260807 00:39:12.804803 29627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:12.804998 29632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:12.802306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55409 (local address 127.0.0.1:35463)
0807 00:39:12.802764 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:12.802774 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:12.802809 (+ 35us) server_negotiation.cc:407] Connection header received
0807 00:39:12.803065 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:12.803073 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:12.803110 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:12.803250 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:12.804384 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:12.804388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:12.804388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:12.804393 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:12.804538 (+ 145us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:12.804555 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:12.804614 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:12.804753 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 00:39:12.804801 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":101,"threads_started":1}
I20260807 00:39:12.806013 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:12.812348 29632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:12.811166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49547 (local address 127.0.0.1:35463)
0807 00:39:12.811214 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:12.811216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:12.811296 (+ 80us) server_negotiation.cc:407] Connection header received
0807 00:39:12.811361 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:12.811362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:12.811368 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:12.811426 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:12.812086 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:12.812088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:12.812088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:12.812093 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:12.812110 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:12.812115 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:12.812171 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:12.812237 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 00:39:12.812251 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:12.812709 29627 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:12.812867 29627 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:12.816802 29627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9153abe0da144a8a840bed223293203: Generated new TSK 0
I20260807 00:39:12.817073 29627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:12.822167 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29548
2026-08-07T00:39:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1379 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:12 dist-test-slave-csg5 krb5kdc[29650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:12 dist-test-slave-csg5 krb5kdc[29650](info): set up 2 sockets
Aug 07 00:39:12 dist-test-slave-csg5 krb5kdc[29650](info): commencing operation
krb5kdc: starting...
W20260807 00:39:13.947743 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:14 dist-test-slave-csg5 krb5kdc[29650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:14.087339 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:14.174059 29664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:14.174295 29664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:14.174322 29664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:14.175607 29664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:14.175662 29664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:14.175678 29664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:14.175690 29664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:14.175702 29664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:14.177328 29664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:14.177618 29664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:14.177863 29664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:14.183032 29669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:14.183032 29670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:14.183064 29672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:14.183852 29664 server_base.cc:1034] running on GCE node
I20260807 00:39:14.184144 29664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:14.184468 29664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:14.185618 29664 hybrid_clock.cc:648] HybridClock initialized: now 1786063154185605 us; error 36 us; skew 500 ppm
Aug 07 00:39:14 dist-test-slave-csg5 krb5kdc[29650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063154, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:14.188316 29664 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:14.188791 29664 webserver.cc:460] Webserver started at http://127.0.0.1:41639/ using document root <none> and password file <none>
I20260807 00:39:14.189043 29664 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:14.189091 29664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:14.189224 29664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:14.190338 29664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "097a1c213a5149f08df8ace5ee98c416"
format_stamp: "Formatted at 2026-08-07 00:39:14 on dist-test-slave-csg5"
server_key: "8a6721f17947f5ac2197331125a28dfc"
server_key_iv: "f7269acfd926cc23046f166be6991b64"
server_key_version: "encryptionkey@0"
I20260807 00:39:14.190778 29664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "097a1c213a5149f08df8ace5ee98c416"
format_stamp: "Formatted at 2026-08-07 00:39:14 on dist-test-slave-csg5"
server_key: "8a6721f17947f5ac2197331125a28dfc"
server_key_iv: "f7269acfd926cc23046f166be6991b64"
server_key_version: "encryptionkey@0"
I20260807 00:39:14.192173 29664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:14.193013 29679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:14.193219 29664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:14.193325 29664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "097a1c213a5149f08df8ace5ee98c416"
format_stamp: "Formatted at 2026-08-07 00:39:14 on dist-test-slave-csg5"
server_key: "8a6721f17947f5ac2197331125a28dfc"
server_key_iv: "f7269acfd926cc23046f166be6991b64"
server_key_version: "encryptionkey@0"
I20260807 00:39:14.193400 29664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:14.210752 29664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:14.213341 29664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:14.213593 29664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:14.218240 29664 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34245
I20260807 00:39:14.218321 29732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34245 every 8 connection(s)
I20260807 00:39:14.218786 29664 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:14.220009 29733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:14.222729 29733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416: Bootstrap starting.
I20260807 00:39:14.223397 29733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:14.223750 29733 log.cc:824] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:14.223846 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29664
I20260807 00:39:14.223975 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:14.224210 8176 external_mini_cluster.cc:1428] Setting key a04d0bdb536ddf860bbd193b0f88a7d6
I20260807 00:39:14.224840 29733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416: No bootstrap required, opened a new log
I20260807 00:39:14.226735 29733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "097a1c213a5149f08df8ace5ee98c416" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34245 } }
I20260807 00:39:14.226936 29733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:14.226987 29733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097a1c213a5149f08df8ace5ee98c416, State: Initialized, Role: FOLLOWER
I20260807 00:39:14.227164 29733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "097a1c213a5149f08df8ace5ee98c416" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34245 } }
I20260807 00:39:14.227255 29733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:14.227314 29733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:14.227370 29733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:14.228267 29733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "097a1c213a5149f08df8ace5ee98c416" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34245 } }
I20260807 00:39:14.228391 29733 leader_election.cc:302] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 097a1c213a5149f08df8ace5ee98c416; no voters:
I20260807 00:39:14.228598 29733 leader_election.cc:288] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:14.228627 29740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:14.228751 29740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [term 1 LEADER]: Becoming Leader. State: Replica: 097a1c213a5149f08df8ace5ee98c416, State: Running, Role: LEADER
I20260807 00:39:14.228895 29733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:14.228893 29740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "097a1c213a5149f08df8ace5ee98c416" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34245 } }
I20260807 00:39:14.229393 29742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 097a1c213a5149f08df8ace5ee98c416. Latest consensus state: current_term: 1 leader_uuid: "097a1c213a5149f08df8ace5ee98c416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "097a1c213a5149f08df8ace5ee98c416" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34245 } } }
I20260807 00:39:14.229405 29741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "097a1c213a5149f08df8ace5ee98c416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "097a1c213a5149f08df8ace5ee98c416" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34245 } } }
I20260807 00:39:14.229504 29742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:14.229526 29741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:14.229774 29748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:14.230386 29748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:14.232096 29748 catalog_manager.cc:1347] Generated new cluster ID: ea0514bc23ca4d0293c3b03914697d26
I20260807 00:39:14.232156 29748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:39:14 dist-test-slave-csg5 krb5kdc[29650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 00:39:14.236223 29748 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:14.236925 29748 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:14.238260 29739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:14.224852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49749 (local address 127.0.0.1:34245)
0807 00:39:14.225084 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:14.225093 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:14.225121 (+ 28us) server_negotiation.cc:407] Connection header received
0807 00:39:14.226805 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:14.226815 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:14.226880 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:14.227082 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:14.227942 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:14.229257 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:14.230585 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:14.231210 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:14.231347 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:14.234066 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:14.234072 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:14.234072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:14.234086 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:14.236379 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:14.236819 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:14.236822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:14.236823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:14.236966 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:14.237243 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:14.237244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:14.237245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:14.237573 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:14.237737 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:14.237834 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 00:39:14.238019 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":125,"threads_started":1}
I20260807 00:39:14.239336 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:14.241981 29748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 097a1c213a5149f08df8ace5ee98c416: Generated new TSK 0
I20260807 00:39:14.242206 29748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:14.251073 29739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:14.242968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59689 (local address 127.0.0.1:34245)
0807 00:39:14.243018 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:14.243020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:14.243122 (+ 102us) server_negotiation.cc:407] Connection header received
0807 00:39:14.243158 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:14.243159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:14.243172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:14.243254 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:14.243781 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:14.244633 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:14.245472 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:14.245874 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:14.245959 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:14.247448 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:14.247449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:14.247450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:14.247459 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:14.249310 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:14.249911 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:14.249913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:14.249913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:14.249985 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:14.250368 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:14.250369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:14.250369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:14.250531 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:14.250643 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:14.250851 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 00:39:14.250950 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 00:39:14.253485 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29664
2026-08-07T00:39:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:14 dist-test-slave-csg5 krb5kdc[29767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:14 dist-test-slave-csg5 krb5kdc[29767](info): set up 2 sockets
Aug 07 00:39:14 dist-test-slave-csg5 krb5kdc[29767](info): commencing operation
krb5kdc: starting...
W20260807 00:39:15.365801 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:15 dist-test-slave-csg5 krb5kdc[29767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:15.519567 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36101
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:15.609978 29780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:15.610257 29780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:15.610291 29780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:15.611661 29780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:15.611719 29780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:15.611734 29780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:15.611747 29780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:15.611760 29780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:15.613463 29780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:15.613708 29780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:15.613896 29780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:15.619292 29787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:15.619297 29786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:15.619297 29789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:15.619460 29780 server_base.cc:1034] running on GCE node
I20260807 00:39:15.619856 29780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:15.620208 29780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:15.621407 29780 hybrid_clock.cc:648] HybridClock initialized: now 1786063155621367 us; error 57 us; skew 500 ppm
Aug 07 00:39:15 dist-test-slave-csg5 krb5kdc[29767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063155, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:15.624498 29780 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:15.624979 29780 webserver.cc:460] Webserver started at http://127.0.0.1:38473/ using document root <none> and password file <none>
I20260807 00:39:15.625234 29780 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:15.625304 29780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:15.625447 29780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:15.626839 29780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "a94497f9669d45c3939908154df0d492"
format_stamp: "Formatted at 2026-08-07 00:39:15 on dist-test-slave-csg5"
server_key: "4da2c1b6c52a41dcb92f3fbf37abe9c5"
server_key_iv: "0cc7751f49970c85307b3b46a4544f96"
server_key_version: "encryptionkey@0"
I20260807 00:39:15.627228 29780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "a94497f9669d45c3939908154df0d492"
format_stamp: "Formatted at 2026-08-07 00:39:15 on dist-test-slave-csg5"
server_key: "4da2c1b6c52a41dcb92f3fbf37abe9c5"
server_key_iv: "0cc7751f49970c85307b3b46a4544f96"
server_key_version: "encryptionkey@0"
I20260807 00:39:15.628692 29780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:15.629616 29796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:15.629935 29780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:15.630065 29780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "a94497f9669d45c3939908154df0d492"
format_stamp: "Formatted at 2026-08-07 00:39:15 on dist-test-slave-csg5"
server_key: "4da2c1b6c52a41dcb92f3fbf37abe9c5"
server_key_iv: "0cc7751f49970c85307b3b46a4544f96"
server_key_version: "encryptionkey@0"
I20260807 00:39:15.630155 29780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:15.649673 29780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:15.652585 29780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:15.652794 29780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:15.657612 29780 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36101
I20260807 00:39:15.657665 29851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36101 every 8 connection(s)
I20260807 00:39:15.658087 29780 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:15.659392 29852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:15.661850 29852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492: Bootstrap starting.
I20260807 00:39:15.662493 29852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:15.662858 29852 log.cc:824] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:15.663863 29852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492: No bootstrap required, opened a new log
I20260807 00:39:15.665746 29852 raft_consensus.cc:348] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94497f9669d45c3939908154df0d492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36101 } }
I20260807 00:39:15.665906 29852 raft_consensus.cc:374] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:15.665930 29852 raft_consensus.cc:729] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a94497f9669d45c3939908154df0d492, State: Initialized, Role: FOLLOWER
I20260807 00:39:15.666090 29852 consensus_queue.cc:260] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94497f9669d45c3939908154df0d492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36101 } }
I20260807 00:39:15.666164 29852 raft_consensus.cc:388] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:15.666188 29852 raft_consensus.cc:482] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:15.666328 29852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:15.666502 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29780
I20260807 00:39:15.666646 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:15.666865 8176 external_mini_cluster.cc:1428] Setting key 6788eb9cef006bf6930515951d81c3ef
I20260807 00:39:15.667201 29852 raft_consensus.cc:504] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94497f9669d45c3939908154df0d492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36101 } }
I20260807 00:39:15.667302 29852 leader_election.cc:302] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a94497f9669d45c3939908154df0d492; no voters:
I20260807 00:39:15.667501 29852 leader_election.cc:288] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:15.667536 29855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:15.667665 29855 raft_consensus.cc:686] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [term 1 LEADER]: Becoming Leader. State: Replica: a94497f9669d45c3939908154df0d492, State: Running, Role: LEADER
I20260807 00:39:15.667743 29855 consensus_queue.cc:237] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94497f9669d45c3939908154df0d492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36101 } }
I20260807 00:39:15.667817 29852 sys_catalog.cc:564] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:15.668076 29855 sys_catalog.cc:455] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a94497f9669d45c3939908154df0d492. Latest consensus state: current_term: 1 leader_uuid: "a94497f9669d45c3939908154df0d492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94497f9669d45c3939908154df0d492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36101 } } }
I20260807 00:39:15.668152 29855 sys_catalog.cc:458] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:15.668109 29859 sys_catalog.cc:455] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a94497f9669d45c3939908154df0d492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94497f9669d45c3939908154df0d492" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36101 } } }
I20260807 00:39:15.668215 29859 sys_catalog.cc:458] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:15.668426 29861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:15.669209 29861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:15.671310 29861 catalog_manager.cc:1347] Generated new cluster ID: c62964a75d644d3e85b44f6b477480e6
I20260807 00:39:15.671392 29861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:15.678351 29858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:15.667509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58717 (local address 127.0.0.1:36101)
0807 00:39:15.667934 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:15.667945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:15.667982 (+ 37us) server_negotiation.cc:407] Connection header received
0807 00:39:15.668117 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:15.668124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:15.668351 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:15.668854 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:15.668955 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:15.671236 (+ 2281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:15.675946 (+ 4710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:15.676671 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:15.676812 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:15.677565 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:15.677570 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:15.677570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:15.677824 (+ 254us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:15.677872 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:15.677888 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:15.677964 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:15.678038 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 00:39:15.678113 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":129,"threads_started":1}
I20260807 00:39:15.679600 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:15.685155 29858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:15.681110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43393 (local address 127.0.0.1:36101)
0807 00:39:15.681156 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:15.681159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:15.681301 (+ 142us) server_negotiation.cc:407] Connection header received
0807 00:39:15.681401 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:15.681402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:15.681414 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:15.681447 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:15.681642 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:15.682419 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:15.683556 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:15.683898 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:15.683942 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:15.684847 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:15.684848 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:15.684848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:15.684854 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:15.684871 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:15.684876 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:15.684905 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:15.685015 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 00:39:15.685047 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:39:15.695956 29861 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:15.696626 29861 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:15.702713 29861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a94497f9669d45c3939908154df0d492: Generated new TSK 0
I20260807 00:39:15.703027 29861 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:15.707366 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29780
2026-08-07T00:39:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:15 dist-test-slave-csg5 krb5kdc[29885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:15 dist-test-slave-csg5 krb5kdc[29885](info): set up 2 sockets
Aug 07 00:39:15 dist-test-slave-csg5 krb5kdc[29885](info): commencing operation
krb5kdc: starting...
W20260807 00:39:16.820210 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:16 dist-test-slave-csg5 krb5kdc[29885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:16.962884 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37203
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:17.049110 29898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:17.049358 29898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:17.049387 29898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:17.050707 29898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:17.050758 29898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:17.050772 29898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:17.050786 29898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:17.050802 29898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:17.052469 29898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:17.052750 29898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:17.052958 29898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:17.058208 29904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:17.058203 29906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:17.058383 29903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:17.058578 29898 server_base.cc:1034] running on GCE node
I20260807 00:39:17.058884 29898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:17.059177 29898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:17.060341 29898 hybrid_clock.cc:648] HybridClock initialized: now 1786063157060304 us; error 51 us; skew 500 ppm
Aug 07 00:39:17 dist-test-slave-csg5 krb5kdc[29885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063157, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:17.069423 29898 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:17.069938 29898 webserver.cc:460] Webserver started at http://127.0.0.1:35759/ using document root <none> and password file <none>
I20260807 00:39:17.070183 29898 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:17.070230 29898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:17.070405 29898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:17.071710 29898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "fb460baab934426cb0360e11ec65253f"
format_stamp: "Formatted at 2026-08-07 00:39:17 on dist-test-slave-csg5"
server_key: "e4dc9924efc043d6c448450a445882d1"
server_key_iv: "6454d7aadf1443ebb16a6a2ece0e4ad0"
server_key_version: "encryptionkey@0"
I20260807 00:39:17.072072 29898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "fb460baab934426cb0360e11ec65253f"
format_stamp: "Formatted at 2026-08-07 00:39:17 on dist-test-slave-csg5"
server_key: "e4dc9924efc043d6c448450a445882d1"
server_key_iv: "6454d7aadf1443ebb16a6a2ece0e4ad0"
server_key_version: "encryptionkey@0"
I20260807 00:39:17.073556 29898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:17.074565 29913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:17.074999 29898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:39:17.075093 29898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "fb460baab934426cb0360e11ec65253f"
format_stamp: "Formatted at 2026-08-07 00:39:17 on dist-test-slave-csg5"
server_key: "e4dc9924efc043d6c448450a445882d1"
server_key_iv: "6454d7aadf1443ebb16a6a2ece0e4ad0"
server_key_version: "encryptionkey@0"
I20260807 00:39:17.075191 29898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:17.078830 29898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:17.081318 29898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:17.081525 29898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:17.086320 29898 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37203
I20260807 00:39:17.086380 29968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37203 every 8 connection(s)
I20260807 00:39:17.086820 29898 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:17.088012 29969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:17.089205 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 29898
I20260807 00:39:17.089371 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:17.089609 8176 external_mini_cluster.cc:1428] Setting key cef6b30ec5ea69fcee626f206e72a8fb
I20260807 00:39:17.091151 29969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f: Bootstrap starting.
I20260807 00:39:17.092010 29969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:17.092366 29969 log.cc:824] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:17.092530 29972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:17.090246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40067 (local address 127.0.0.1:37203)
0807 00:39:17.090473 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:17.090481 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:17.090511 (+ 30us) server_negotiation.cc:407] Connection header received
0807 00:39:17.091032 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:17.091040 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:17.091071 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:17.091202 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:17.092004 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:17.092008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:17.092008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:17.092012 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:17.092084 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:17.092099 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:17.092213 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:17.092272 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 00:39:17.092322 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":114,"threads_started":1}
I20260807 00:39:17.093205 29969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f: No bootstrap required, opened a new log
I20260807 00:39:17.093628 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:17.095510 29969 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb460baab934426cb0360e11ec65253f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37203 } }
I20260807 00:39:17.095678 29969 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:17.095726 29969 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb460baab934426cb0360e11ec65253f, State: Initialized, Role: FOLLOWER
I20260807 00:39:17.095872 29969 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb460baab934426cb0360e11ec65253f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37203 } }
I20260807 00:39:17.096055 29969 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:17.096130 29969 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:17.096310 29969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:17.096396 29972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:17.095232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51571 (local address 127.0.0.1:37203)
0807 00:39:17.095268 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:17.095269 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:17.095405 (+ 136us) server_negotiation.cc:407] Connection header received
0807 00:39:17.095488 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:17.095489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:17.095494 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:17.095546 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:17.096169 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:17.096170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:17.096170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:17.096175 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:17.096190 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:17.096195 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:17.096247 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:17.096300 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 00:39:17.096315 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 00:39:17.097205 29969 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb460baab934426cb0360e11ec65253f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37203 } }
I20260807 00:39:17.097303 29969 leader_election.cc:302] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb460baab934426cb0360e11ec65253f; no voters:
I20260807 00:39:17.097503 29969 leader_election.cc:288] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:17.097534 29981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:17.097770 29981 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [term 1 LEADER]: Becoming Leader. State: Replica: fb460baab934426cb0360e11ec65253f, State: Running, Role: LEADER
I20260807 00:39:17.097795 29969 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:17.097870 29981 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb460baab934426cb0360e11ec65253f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37203 } }
I20260807 00:39:17.098299 29982 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb460baab934426cb0360e11ec65253f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb460baab934426cb0360e11ec65253f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37203 } } }
I20260807 00:39:17.098311 29983 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb460baab934426cb0360e11ec65253f. Latest consensus state: current_term: 1 leader_uuid: "fb460baab934426cb0360e11ec65253f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb460baab934426cb0360e11ec65253f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37203 } } }
I20260807 00:39:17.098487 29983 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:17.098415 29982 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f [sys.catalog]: This master's current role is: LEADER
W20260807 00:39:17.099768 29997 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:17.099836 29997 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:17.099887 29990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:17.100055 29990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:17.101729 29990 catalog_manager.cc:1347] Generated new cluster ID: c5cdbf9df98943f2b2a27ef75c7b6f5c
I20260807 00:39:17.101788 29990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:17.145884 29990 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:17.146131 29990 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:17.155639 29990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb460baab934426cb0360e11ec65253f: Generated new TSK 0
I20260807 00:39:17.155915 29990 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:17.171919 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 29898
2026-08-07T00:39:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1464 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:17 dist-test-slave-csg5 krb5kdc[30002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:17 dist-test-slave-csg5 krb5kdc[30002](info): set up 2 sockets
Aug 07 00:39:17 dist-test-slave-csg5 krb5kdc[30002](info): commencing operation
krb5kdc: starting...
W20260807 00:39:18.297194 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:18 dist-test-slave-csg5 krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:18.438994 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36393
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:18.530073 30016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:18.530331 30016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:18.530359 30016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:18.531704 30016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:18.531770 30016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:18.531785 30016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:18.531798 30016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:18.531811 30016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:18.533454 30016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:18.533744 30016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:18.534008 30016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:39:18.539644 30016 server_base.cc:1034] running on GCE node
W20260807 00:39:18.539589 30026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:18.539589 30022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:18.539603 30023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:18.540084 30016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:18.540485 30016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:18.541669 30016 hybrid_clock.cc:648] HybridClock initialized: now 1786063158541653 us; error 49 us; skew 500 ppm
Aug 07 00:39:18 dist-test-slave-csg5 krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063158, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:18.544576 30016 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:18.545183 30016 webserver.cc:460] Webserver started at http://127.0.0.1:43601/ using document root <none> and password file <none>
I20260807 00:39:18.545467 30016 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:18.545542 30016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:18.545701 30016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:18.546986 30016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "02bacc94cc8b421c9a975e401966a621"
format_stamp: "Formatted at 2026-08-07 00:39:18 on dist-test-slave-csg5"
server_key: "39a735d0049c9fdb3ed57fd655c8df63"
server_key_iv: "61875ee80ce0be60e3aa54d3bf710bab"
server_key_version: "encryptionkey@0"
I20260807 00:39:18.547387 30016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "02bacc94cc8b421c9a975e401966a621"
format_stamp: "Formatted at 2026-08-07 00:39:18 on dist-test-slave-csg5"
server_key: "39a735d0049c9fdb3ed57fd655c8df63"
server_key_iv: "61875ee80ce0be60e3aa54d3bf710bab"
server_key_version: "encryptionkey@0"
I20260807 00:39:18.548944 30016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:18.549837 30033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:18.550065 30016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:18.550191 30016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "02bacc94cc8b421c9a975e401966a621"
format_stamp: "Formatted at 2026-08-07 00:39:18 on dist-test-slave-csg5"
server_key: "39a735d0049c9fdb3ed57fd655c8df63"
server_key_iv: "61875ee80ce0be60e3aa54d3bf710bab"
server_key_version: "encryptionkey@0"
I20260807 00:39:18.550340 30016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:18.582353 30016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:18.584897 30016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:18.585090 30016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:18.589751 30016 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36393
I20260807 00:39:18.589830 30091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36393 every 8 connection(s)
I20260807 00:39:18.590202 30016 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:18.591406 30093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:18.593838 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621: Bootstrap starting.
I20260807 00:39:18.594475 30093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:18.594740 30093 log.cc:824] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:18.595464 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621: No bootstrap required, opened a new log
I20260807 00:39:18.595815 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30016
I20260807 00:39:18.595970 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:18.596166 8176 external_mini_cluster.cc:1428] Setting key 138d1ffa2eb6b5f114ff55fc7fe2f549
I20260807 00:39:18.597735 30093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02bacc94cc8b421c9a975e401966a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36393 } }
I20260807 00:39:18.597908 30093 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:18.597954 30093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02bacc94cc8b421c9a975e401966a621, State: Initialized, Role: FOLLOWER
I20260807 00:39:18.598083 30093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02bacc94cc8b421c9a975e401966a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36393 } }
I20260807 00:39:18.598177 30093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:18.598223 30093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:18.598273 30093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:18.599288 30093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02bacc94cc8b421c9a975e401966a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36393 } }
I20260807 00:39:18.599411 30093 leader_election.cc:302] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02bacc94cc8b421c9a975e401966a621; no voters:
I20260807 00:39:18.599604 30093 leader_election.cc:288] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:18.599635 30098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:18.599766 30098 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [term 1 LEADER]: Becoming Leader. State: Replica: 02bacc94cc8b421c9a975e401966a621, State: Running, Role: LEADER
I20260807 00:39:18.599852 30098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02bacc94cc8b421c9a975e401966a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36393 } }
I20260807 00:39:18.599897 30093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:18.600198 30098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02bacc94cc8b421c9a975e401966a621. Latest consensus state: current_term: 1 leader_uuid: "02bacc94cc8b421c9a975e401966a621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02bacc94cc8b421c9a975e401966a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36393 } } }
I20260807 00:39:18.600293 30098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:18.600378 30099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02bacc94cc8b421c9a975e401966a621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02bacc94cc8b421c9a975e401966a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36393 } } }
I20260807 00:39:18.600471 30099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:18.601059 30104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:18.601560 30104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:18.603628 30104 catalog_manager.cc:1347] Generated new cluster ID: 06846cff167c407b929ebb6fc07ad69e
I20260807 00:39:18.603684 30104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:39:18 dist-test-slave-csg5 krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 00:39:18.608274 30097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:18.596934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:35709 (local address 127.0.0.1:36393)
0807 00:39:18.597117 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:18.597125 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:18.597151 (+ 26us) server_negotiation.cc:407] Connection header received
0807 00:39:18.597739 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:18.597748 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:18.597809 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:18.597981 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:18.598788 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:18.599911 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:18.601049 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:18.601665 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:18.601785 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:18.604640 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:18.604644 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:18.604644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:18.604657 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:18.606422 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:18.606902 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:18.606905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:18.606905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:18.607016 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:18.607255 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:18.607256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:18.607256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:18.607514 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:18.607704 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:18.607814 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 00:39:18.607929 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260807 00:39:18.609305 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:18.610229 30104 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:18.611022 30104 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:18.617234 30097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:18.610881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:43045 (local address 127.0.0.1:36393)
0807 00:39:18.610975 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:18.610977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:18.611023 (+ 46us) server_negotiation.cc:407] Connection header received
0807 00:39:18.611139 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:18.611139 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:18.611148 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:18.611216 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:18.611736 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:18.612278 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:18.612998 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:18.613244 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:18.613347 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:18.614574 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:18.614575 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:18.614576 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:18.614583 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:18.616072 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:18.616443 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:18.616445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:18.616445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:18.616506 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:18.616729 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:18.616730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:18.616731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:18.616840 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:18.616947 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:18.617066 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 00:39:18.617132 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 00:39:18.621119 30104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02bacc94cc8b421c9a975e401966a621: Generated new TSK 0
I20260807 00:39:18.621395 30104 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:18.625483 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30016
W20260807 00:39:18.632359 30000 connection.cc:535] client connection to 127.0.0.1:36393 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36393): Connection reset by peer (error 104)
2026-08-07T00:39:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:18 dist-test-slave-csg5 krb5kdc[30128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:18 dist-test-slave-csg5 krb5kdc[30128](info): set up 2 sockets
Aug 07 00:39:18 dist-test-slave-csg5 krb5kdc[30128](info): commencing operation
krb5kdc: starting...
W20260807 00:39:19.755409 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:19 dist-test-slave-csg5 krb5kdc[30128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:19.900604 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39319
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:19.988070 30143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:19.988364 30143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:19.988410 30143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:19.989658 30143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:19.989733 30143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:19.989759 30143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:19.989782 30143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:19.989809 30143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:19.991489 30143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:19.991798 30143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:19.992044 30143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:19.997184 30149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:19.997200 30151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:19.997344 30143 server_base.cc:1034] running on GCE node
W20260807 00:39:19.997203 30148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:19.997866 30143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:19.998216 30143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:19.999454 30143 hybrid_clock.cc:648] HybridClock initialized: now 1786063159999421 us; error 43 us; skew 500 ppm
Aug 07 00:39:19 dist-test-slave-csg5 krb5kdc[30128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063159, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:20.002458 30143 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:20.003032 30143 webserver.cc:460] Webserver started at http://127.0.0.1:42025/ using document root <none> and password file <none>
I20260807 00:39:20.003304 30143 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:20.003382 30143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:20.003538 30143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:20.004667 30143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91"
format_stamp: "Formatted at 2026-08-07 00:39:19 on dist-test-slave-csg5"
server_key: "10710f2189dc6283ab575a73c8bfc4c3"
server_key_iv: "635b98a2192a0e15c70b11669b7dc8f8"
server_key_version: "encryptionkey@0"
I20260807 00:39:20.005050 30143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91"
format_stamp: "Formatted at 2026-08-07 00:39:19 on dist-test-slave-csg5"
server_key: "10710f2189dc6283ab575a73c8bfc4c3"
server_key_iv: "635b98a2192a0e15c70b11669b7dc8f8"
server_key_version: "encryptionkey@0"
I20260807 00:39:20.006781 30143 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 00:39:20.007822 30158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:20.008232 30143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:20.008430 30143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91"
format_stamp: "Formatted at 2026-08-07 00:39:19 on dist-test-slave-csg5"
server_key: "10710f2189dc6283ab575a73c8bfc4c3"
server_key_iv: "635b98a2192a0e15c70b11669b7dc8f8"
server_key_version: "encryptionkey@0"
I20260807 00:39:20.008527 30143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:20.027402 30143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:20.030201 30143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:20.030478 30143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:20.034952 30143 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39319
I20260807 00:39:20.035048 30211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39319 every 8 connection(s)
I20260807 00:39:20.035440 30143 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:20.036777 30212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:20.037461 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30143
I20260807 00:39:20.037636 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:20.037853 8176 external_mini_cluster.cc:1428] Setting key 3a5b250ba3f648a9817d7059e295eee9
I20260807 00:39:20.040445 30212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91: Bootstrap starting.
I20260807 00:39:20.041224 30212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:20.041551 30212 log.cc:824] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:20.042353 30212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91: No bootstrap required, opened a new log
I20260807 00:39:20.044188 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:20.038459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:55865 (local address 127.0.0.1:39319)
0807 00:39:20.038715 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:20.038731 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:20.038782 (+ 51us) server_negotiation.cc:407] Connection header received
0807 00:39:20.039279 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:20.039287 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:20.039355 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:20.039480 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:20.039961 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:20.041003 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:20.042049 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:20.042564 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:20.042698 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:20.043457 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:20.043461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:20.043461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:20.043638 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:20.043679 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:20.043713 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:20.043786 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:20.043941 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 00:39:20.043980 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260807 00:39:20.044834 30212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39319 } }
I20260807 00:39:20.044991 30212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:20.045058 30212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bb89ba54c9b4ae59edfc9bddabf3b91, State: Initialized, Role: FOLLOWER
I20260807 00:39:20.045203 30212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39319 } }
I20260807 00:39:20.045307 30212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:20.045348 30212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:20.045394 30212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:20.045426 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:20.046010 30212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39319 } }
I20260807 00:39:20.046101 30212 leader_election.cc:302] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bb89ba54c9b4ae59edfc9bddabf3b91; no voters:
I20260807 00:39:20.046330 30212 leader_election.cc:288] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:20.046363 30217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:20.046481 30217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [term 1 LEADER]: Becoming Leader. State: Replica: 0bb89ba54c9b4ae59edfc9bddabf3b91, State: Running, Role: LEADER
I20260807 00:39:20.046567 30217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39319 } }
I20260807 00:39:20.046626 30212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:20.046931 30217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bb89ba54c9b4ae59edfc9bddabf3b91. Latest consensus state: current_term: 1 leader_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39319 } } }
I20260807 00:39:20.046941 30218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb89ba54c9b4ae59edfc9bddabf3b91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39319 } } }
I20260807 00:39:20.047012 30217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:20.047065 30218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:20.047289 30226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:20.047801 30226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:20.049655 30226 catalog_manager.cc:1347] Generated new cluster ID: 98629740c47643a2b8d11090ac2929d0
I20260807 00:39:20.049718 30226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:20.051939 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:20.048240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:37359 (local address 127.0.0.1:39319)
0807 00:39:20.048277 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:20.048279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:20.048469 (+ 190us) server_negotiation.cc:407] Connection header received
0807 00:39:20.048548 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:20.048549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:20.048560 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:20.048611 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:20.049127 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:20.049827 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:20.050590 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:20.050886 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:20.050966 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:20.051703 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:20.051704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:20.051705 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:20.051710 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:20.051725 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:20.051730 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:20.051784 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:20.051844 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 00:39:20.051854 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:39:20.064353 30226 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:20.064942 30226 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:20.068118 30226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bb89ba54c9b4ae59edfc9bddabf3b91: Generated new TSK 0
I20260807 00:39:20.068347 30226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:20.073454 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30143
W20260807 00:39:20.079479 30126 connection.cc:535] client connection to 127.0.0.1:39319 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39319): Connection reset by peer (error 104)
2026-08-07T00:39:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:20 dist-test-slave-csg5 krb5kdc[30245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:20 dist-test-slave-csg5 krb5kdc[30245](info): set up 2 sockets
Aug 07 00:39:20 dist-test-slave-csg5 krb5kdc[30245](info): commencing operation
krb5kdc: starting...
W20260807 00:39:21.188431 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:21 dist-test-slave-csg5 krb5kdc[30245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:21.322134 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39841
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:21.408370 30258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:21.408656 30258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:21.408704 30258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:21.409976 30258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:21.410053 30258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:21.410079 30258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:21.410108 30258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:21.410138 30258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:21.411805 30258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:21.412145 30258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:21.412420 30258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:21.417907 30263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:21.417907 30265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:21.417936 30267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:21.418366 30258 server_base.cc:1034] running on GCE node
I20260807 00:39:21.418587 30258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:21.418960 30258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:21.420126 30258 hybrid_clock.cc:648] HybridClock initialized: now 1786063161420085 us; error 54 us; skew 500 ppm
Aug 07 00:39:21 dist-test-slave-csg5 krb5kdc[30245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063161, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:21.423233 30258 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:21.423808 30258 webserver.cc:460] Webserver started at http://127.0.0.1:44609/ using document root <none> and password file <none>
I20260807 00:39:21.424060 30258 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:21.424134 30258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:21.424294 30258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:21.425493 30258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "c62d996b2de54ec9909c276845f0567b"
format_stamp: "Formatted at 2026-08-07 00:39:21 on dist-test-slave-csg5"
server_key: "2ea63ba481281863adabd9658167b825"
server_key_iv: "437ab3a23f81f2efcf72a5beb2360105"
server_key_version: "encryptionkey@0"
I20260807 00:39:21.425900 30258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "c62d996b2de54ec9909c276845f0567b"
format_stamp: "Formatted at 2026-08-07 00:39:21 on dist-test-slave-csg5"
server_key: "2ea63ba481281863adabd9658167b825"
server_key_iv: "437ab3a23f81f2efcf72a5beb2360105"
server_key_version: "encryptionkey@0"
I20260807 00:39:21.427477 30258 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:21.428365 30274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:21.428704 30258 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:21.428815 30258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "c62d996b2de54ec9909c276845f0567b"
format_stamp: "Formatted at 2026-08-07 00:39:21 on dist-test-slave-csg5"
server_key: "2ea63ba481281863adabd9658167b825"
server_key_iv: "437ab3a23f81f2efcf72a5beb2360105"
server_key_version: "encryptionkey@0"
I20260807 00:39:21.428915 30258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:21.432737 30258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:21.435489 30258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:21.435704 30258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:21.440873 30258 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39841
I20260807 00:39:21.440925 30328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39841 every 8 connection(s)
I20260807 00:39:21.441315 30258 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:21.442373 30329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:21.444958 30329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b: Bootstrap starting.
I20260807 00:39:21.445546 30329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:21.445789 30329 log.cc:824] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:21.446517 30329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b: No bootstrap required, opened a new log
I20260807 00:39:21.448388 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30258
I20260807 00:39:21.448519 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:21.448359 30329 raft_consensus.cc:348] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d996b2de54ec9909c276845f0567b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39841 } }
I20260807 00:39:21.448552 30329 raft_consensus.cc:374] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:21.448590 30329 raft_consensus.cc:729] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c62d996b2de54ec9909c276845f0567b, State: Initialized, Role: FOLLOWER
I20260807 00:39:21.448716 8176 external_mini_cluster.cc:1428] Setting key 048c118eab0232498781f34fab4d920f
I20260807 00:39:21.448761 30329 consensus_queue.cc:260] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d996b2de54ec9909c276845f0567b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39841 } }
I20260807 00:39:21.448849 30329 raft_consensus.cc:388] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:21.448910 30329 raft_consensus.cc:482] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:21.448971 30329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:21.450169 30329 raft_consensus.cc:504] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d996b2de54ec9909c276845f0567b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39841 } }
I20260807 00:39:21.450299 30329 leader_election.cc:302] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c62d996b2de54ec9909c276845f0567b; no voters:
I20260807 00:39:21.450497 30329 leader_election.cc:288] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:21.450533 30334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:21.450717 30334 raft_consensus.cc:686] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [term 1 LEADER]: Becoming Leader. State: Replica: c62d996b2de54ec9909c276845f0567b, State: Running, Role: LEADER
I20260807 00:39:21.450812 30329 sys_catalog.cc:564] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:21.450929 30334 consensus_queue.cc:237] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d996b2de54ec9909c276845f0567b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39841 } }
I20260807 00:39:21.451434 30335 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c62d996b2de54ec9909c276845f0567b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d996b2de54ec9909c276845f0567b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39841 } } }
I20260807 00:39:21.451532 30335 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:21.451892 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:21.449264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:35809 (local address 127.0.0.1:39841)
0807 00:39:21.449530 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:21.449542 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:21.449583 (+ 41us) server_negotiation.cc:407] Connection header received
0807 00:39:21.449753 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:21.449762 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:21.449806 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:21.449964 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:21.450979 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:21.450984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:21.450984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:21.450990 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:21.451043 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:21.451061 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:21.451124 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:21.451240 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 00:39:21.451297 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":133,"threads_started":1}
I20260807 00:39:21.452467 30336 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c62d996b2de54ec9909c276845f0567b. Latest consensus state: current_term: 1 leader_uuid: "c62d996b2de54ec9909c276845f0567b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d996b2de54ec9909c276845f0567b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39841 } } }
I20260807 00:39:21.452710 30336 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b [sys.catalog]: This master's current role is: LEADER
W20260807 00:39:21.452745 30350 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:21.452811 30350 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:21.452872 30343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:21.452975 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:21.453070 30343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:21.454627 30343 catalog_manager.cc:1347] Generated new cluster ID: a6bf311a54d749baa822833892ff0993
I20260807 00:39:21.454698 30343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:21.455871 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:21.454754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:59649 (local address 127.0.0.1:39841)
0807 00:39:21.454790 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:21.454793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:21.454802 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:21.454883 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:21.454884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:21.454890 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:21.454920 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:21.455626 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:21.455627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:21.455627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:21.455632 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:21.455649 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:21.455654 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:21.455710 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:21.455786 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 00:39:21.455800 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:39:21.473815 30343 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:21.474063 30343 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:21.478149 30343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c62d996b2de54ec9909c276845f0567b: Generated new TSK 0
I20260807 00:39:21.478384 30343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:21.484128 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30258
2026-08-07T00:39:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1410 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:21 dist-test-slave-csg5 krb5kdc[30360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:21 dist-test-slave-csg5 krb5kdc[30360](info): set up 2 sockets
Aug 07 00:39:21 dist-test-slave-csg5 krb5kdc[30360](info): commencing operation
krb5kdc: starting...
W20260807 00:39:22.612185 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:22 dist-test-slave-csg5 krb5kdc[30360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:22.755200 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46273
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:22.842519 30373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:22.842783 30373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:22.842810 30373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:22.844084 30373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:22.844138 30373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:22.844152 30373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:22.844172 30373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:22.844184 30373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:22.845810 30373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46273
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:22.846091 30373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:22.846345 30373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:22.851727 30381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:22.851747 30378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:22.851814 30373 server_base.cc:1034] running on GCE node
W20260807 00:39:22.851763 30379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:22.852312 30373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:22.852640 30373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:22.853808 30373 hybrid_clock.cc:648] HybridClock initialized: now 1786063162853791 us; error 42 us; skew 500 ppm
Aug 07 00:39:22 dist-test-slave-csg5 krb5kdc[30360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063162, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:22.861675 30373 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:22.862285 30373 webserver.cc:460] Webserver started at http://127.0.0.1:36153/ using document root <none> and password file <none>
I20260807 00:39:22.862604 30373 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:22.862730 30373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:22.862916 30373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:22.864181 30373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "0f1dad3c7a44460ca4aa0647abaef33a"
format_stamp: "Formatted at 2026-08-07 00:39:22 on dist-test-slave-csg5"
server_key: "90556d8b979023ab684447cb4192fb8e"
server_key_iv: "a6e600bd2a4613dc5b38e2d1c590dc35"
server_key_version: "encryptionkey@0"
I20260807 00:39:22.864609 30373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "0f1dad3c7a44460ca4aa0647abaef33a"
format_stamp: "Formatted at 2026-08-07 00:39:22 on dist-test-slave-csg5"
server_key: "90556d8b979023ab684447cb4192fb8e"
server_key_iv: "a6e600bd2a4613dc5b38e2d1c590dc35"
server_key_version: "encryptionkey@0"
I20260807 00:39:22.866266 30373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:22.867365 30389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:22.867609 30373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 00:39:22.867722 30373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "0f1dad3c7a44460ca4aa0647abaef33a"
format_stamp: "Formatted at 2026-08-07 00:39:22 on dist-test-slave-csg5"
server_key: "90556d8b979023ab684447cb4192fb8e"
server_key_iv: "a6e600bd2a4613dc5b38e2d1c590dc35"
server_key_version: "encryptionkey@0"
I20260807 00:39:22.867807 30373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:22.890353 30373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:22.893117 30373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:22.893597 30373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:22.899273 30373 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46273
I20260807 00:39:22.899366 30443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46273 every 8 connection(s)
I20260807 00:39:22.899785 30373 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:22.901057 30444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:22.901567 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30373
I20260807 00:39:22.901726 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:22.901953 8176 external_mini_cluster.cc:1428] Setting key ba7f47a1bdba0981426e6de16bb8d1a4
I20260807 00:39:22.904830 30444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a: Bootstrap starting.
I20260807 00:39:22.905661 30444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:22.906023 30444 log.cc:824] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:22.906992 30444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a: No bootstrap required, opened a new log
I20260807 00:39:22.909564 30444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46273 } }
I20260807 00:39:22.909718 30444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:22.909744 30444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f1dad3c7a44460ca4aa0647abaef33a, State: Initialized, Role: FOLLOWER
I20260807 00:39:22.909893 30444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46273 } }
I20260807 00:39:22.909971 30444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:22.909994 30444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:22.910064 30444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 0 FOLLOWER]: Advancing to term 1
Aug 07 00:39:22 dist-test-slave-csg5 krb5kdc[30360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 00:39:22.910760 30444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46273 } }
I20260807 00:39:22.910854 30444 leader_election.cc:302] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f1dad3c7a44460ca4aa0647abaef33a; no voters:
I20260807 00:39:22.911113 30444 leader_election.cc:288] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:22.911197 30449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:22.911393 30449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [term 1 LEADER]: Becoming Leader. State: Replica: 0f1dad3c7a44460ca4aa0647abaef33a, State: Running, Role: LEADER
I20260807 00:39:22.911429 30444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:22.911552 30449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46273 } }
I20260807 00:39:22.912056 30450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46273 } } }
I20260807 00:39:22.912091 30452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f1dad3c7a44460ca4aa0647abaef33a. Latest consensus state: current_term: 1 leader_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f1dad3c7a44460ca4aa0647abaef33a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46273 } } }
I20260807 00:39:22.912245 30452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:22.912496 30460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:22.912232 30450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:22.913209 30460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:22.915166 30460 catalog_manager.cc:1347] Generated new cluster ID: 61bb9199b4ef4375b46bc1f916164947
I20260807 00:39:22.915237 30460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:22.916201 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:22.902770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:33435 (local address 127.0.0.1:46273)
0807 00:39:22.902991 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:22.903003 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:22.903043 (+ 40us) server_negotiation.cc:407] Connection header received
0807 00:39:22.903652 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:22.903663 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:22.903777 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:22.903955 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:22.904788 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:22.906372 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:22.907328 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:22.907951 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:22.908081 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:22.911336 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:22.911341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:22.911341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:22.911358 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:22.913755 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:22.914343 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:22.914347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:22.914347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:22.914464 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:22.914780 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:22.914781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:22.914781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:22.915120 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:22.915302 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:22.915848 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 00:39:22.915971 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260807 00:39:22.917268 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:22.928182 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:22.918966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:47287 (local address 127.0.0.1:46273)
0807 00:39:22.919009 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:22.919012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:22.919347 (+ 335us) server_negotiation.cc:407] Connection header received
0807 00:39:22.919375 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:22.919376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:22.919388 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:22.919448 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:22.920109 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:22.921343 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:22.922367 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:22.922802 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:22.922888 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:22.924645 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:22.924647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:22.924647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:22.924656 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:22.926708 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:22.927208 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:22.927210 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:22.927210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:22.927281 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:22.927544 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:22.927545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:22.927545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:22.927702 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:22.927820 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:22.927985 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 00:39:22.928066 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:22.964411 30460 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:22.965080 30460 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:22.974301 30460 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f1dad3c7a44460ca4aa0647abaef33a: Generated new TSK 0
I20260807 00:39:22.974558 30460 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:22.982776 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30373
W20260807 00:39:22.989416 30358 connection.cc:535] client connection to 127.0.0.1:46273 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46273): Connection reset by peer (error 104)
2026-08-07T00:39:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1499 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:23 dist-test-slave-csg5 krb5kdc[30478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:23 dist-test-slave-csg5 krb5kdc[30478](info): set up 2 sockets
Aug 07 00:39:23 dist-test-slave-csg5 krb5kdc[30478](info): commencing operation
krb5kdc: starting...
W20260807 00:39:24.136655 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:24 dist-test-slave-csg5 krb5kdc[30478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:24.270558 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41889
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:24.360225 30491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:24.360499 30491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:24.360584 30491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:24.361855 30491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:24.361927 30491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:24.361953 30491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:24.361984 30491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:24.362011 30491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:24.363713 30491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41889
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:24.364027 30491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:24.364281 30491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:24.370081 30497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:24.370042 30499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:24.370042 30496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:24.370448 30491 server_base.cc:1034] running on GCE node
I20260807 00:39:24.370766 30491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:24.371062 30491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:24.372231 30491 hybrid_clock.cc:648] HybridClock initialized: now 1786063164372227 us; error 54 us; skew 500 ppm
Aug 07 00:39:24 dist-test-slave-csg5 krb5kdc[30478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063164, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:24.375454 30491 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:24.375982 30491 webserver.cc:460] Webserver started at http://127.0.0.1:40469/ using document root <none> and password file <none>
I20260807 00:39:24.376255 30491 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:24.376343 30491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:24.376542 30491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:24.377684 30491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "4660abec6fe74347932fa4e4a03a8a6f"
format_stamp: "Formatted at 2026-08-07 00:39:24 on dist-test-slave-csg5"
server_key: "a4a4ab503273f3812527e509343d2e80"
server_key_iv: "101ac8c91e0fa0640652d6e512a1750f"
server_key_version: "encryptionkey@0"
I20260807 00:39:24.378080 30491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "4660abec6fe74347932fa4e4a03a8a6f"
format_stamp: "Formatted at 2026-08-07 00:39:24 on dist-test-slave-csg5"
server_key: "a4a4ab503273f3812527e509343d2e80"
server_key_iv: "101ac8c91e0fa0640652d6e512a1750f"
server_key_version: "encryptionkey@0"
I20260807 00:39:24.379599 30491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:24.380486 30507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:24.380743 30491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:24.380857 30491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "4660abec6fe74347932fa4e4a03a8a6f"
format_stamp: "Formatted at 2026-08-07 00:39:24 on dist-test-slave-csg5"
server_key: "a4a4ab503273f3812527e509343d2e80"
server_key_iv: "101ac8c91e0fa0640652d6e512a1750f"
server_key_version: "encryptionkey@0"
I20260807 00:39:24.380947 30491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:24.402318 30491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:24.405012 30491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:24.405205 30491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:24.409829 30491 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41889
I20260807 00:39:24.409900 30561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41889 every 8 connection(s)
I20260807 00:39:24.410296 30491 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:24.411405 30562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:24.413889 30562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f: Bootstrap starting.
I20260807 00:39:24.414544 30562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:24.414903 30562 log.cc:824] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:24.415786 30562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f: No bootstrap required, opened a new log
I20260807 00:39:24.417306 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30491
I20260807 00:39:24.417475 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:24.417686 8176 external_mini_cluster.cc:1428] Setting key 8e8e817a1859d9ab0f0dcf231e1704aa
I20260807 00:39:24.417721 30562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4660abec6fe74347932fa4e4a03a8a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41889 } }
I20260807 00:39:24.417966 30562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:24.418020 30562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4660abec6fe74347932fa4e4a03a8a6f, State: Initialized, Role: FOLLOWER
I20260807 00:39:24.418206 30562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4660abec6fe74347932fa4e4a03a8a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41889 } }
I20260807 00:39:24.418385 30562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:24.418442 30562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:24.418499 30562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:24.419450 30562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4660abec6fe74347932fa4e4a03a8a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41889 } }
I20260807 00:39:24.419576 30562 leader_election.cc:302] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4660abec6fe74347932fa4e4a03a8a6f; no voters:
I20260807 00:39:24.419745 30562 leader_election.cc:288] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:24.419770 30567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:24.419888 30567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [term 1 LEADER]: Becoming Leader. State: Replica: 4660abec6fe74347932fa4e4a03a8a6f, State: Running, Role: LEADER
I20260807 00:39:24.420043 30562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:24.420037 30567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4660abec6fe74347932fa4e4a03a8a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41889 } }
I20260807 00:39:24.420629 30569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4660abec6fe74347932fa4e4a03a8a6f. Latest consensus state: current_term: 1 leader_uuid: "4660abec6fe74347932fa4e4a03a8a6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4660abec6fe74347932fa4e4a03a8a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41889 } } }
I20260807 00:39:24.420743 30569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:24.421195 30568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4660abec6fe74347932fa4e4a03a8a6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4660abec6fe74347932fa4e4a03a8a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41889 } } }
I20260807 00:39:24.421345 30568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:24.421530 30575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:24.422071 30575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:24.423969 30575 catalog_manager.cc:1347] Generated new cluster ID: ba807778174d4b038048940422889d58
I20260807 00:39:24.424072 30575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:24.424561 30566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:24.418411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:50413 (local address 127.0.0.1:41889)
0807 00:39:24.418673 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:24.418685 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:24.418858 (+ 173us) server_negotiation.cc:407] Connection header received
0807 00:39:24.419318 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:24.419327 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:24.419400 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:24.419567 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:24.419935 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:24.421336 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:24.422335 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:24.423011 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:24.423132 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:24.423946 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:24.423949 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:24.423949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:24.424128 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:24.424159 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:24.424171 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:24.424271 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:24.424352 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 00:39:24.424384 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":131,"threads_started":1}
I20260807 00:39:24.425554 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:24.433876 30566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:24.426989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:33641 (local address 127.0.0.1:41889)
0807 00:39:24.427034 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:24.427036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:24.430945 (+ 3909us) server_negotiation.cc:407] Connection header received
0807 00:39:24.431034 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:24.431035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:24.431047 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:24.431095 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:24.431255 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:24.431814 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:24.432549 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:24.432781 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:24.432872 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:24.433614 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:24.433615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:24.433616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:24.433621 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:24.433637 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:24.433641 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:24.433696 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:24.433759 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 00:39:24.433772 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:39:24.440940 30575 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:24.441537 30575 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:24.448652 30575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4660abec6fe74347932fa4e4a03a8a6f: Generated new TSK 0
I20260807 00:39:24.448891 30575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:24.454015 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30491
W20260807 00:39:24.459517 30476 connection.cc:535] client connection to 127.0.0.1:41889 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41889): Connection reset by peer (error 104)
2026-08-07T00:39:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1469 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:24 dist-test-slave-csg5 krb5kdc[30594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:24 dist-test-slave-csg5 krb5kdc[30594](info): set up 2 sockets
Aug 07 00:39:24 dist-test-slave-csg5 krb5kdc[30594](info): commencing operation
krb5kdc: starting...
W20260807 00:39:25.578131 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:25 dist-test-slave-csg5 krb5kdc[30594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 00:39:25.723028 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38905
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:25.811774 30609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:25.812003 30609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:25.812029 30609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:25.813208 30609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:25.813261 30609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:25.813277 30609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:25.813290 30609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:25.813303 30609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:25.814985 30609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:25.815225 30609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:25.815428 30609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:25.821416 30615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:25.821383 30614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:25.821450 30617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:25.821720 30609 server_base.cc:1034] running on GCE node
I20260807 00:39:25.822016 30609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:25.822374 30609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:25.823559 30609 hybrid_clock.cc:648] HybridClock initialized: now 1786063165823544 us; error 46 us; skew 500 ppm
Aug 07 00:39:25 dist-test-slave-csg5 krb5kdc[30594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063165, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:25.826397 30609 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 00:39:25.826964 30609 webserver.cc:460] Webserver started at http://127.0.0.1:42187/ using document root <none> and password file <none>
I20260807 00:39:25.827231 30609 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:25.827303 30609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:25.827456 30609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:25.828691 30609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "e9ba79389e67452fa257089422af4efc"
format_stamp: "Formatted at 2026-08-07 00:39:25 on dist-test-slave-csg5"
server_key: "98a1a5503b5861f37d13eff8d84af1f3"
server_key_iv: "571be0114d7a9f01e50793cf93d92c6f"
server_key_version: "encryptionkey@0"
I20260807 00:39:25.829084 30609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "e9ba79389e67452fa257089422af4efc"
format_stamp: "Formatted at 2026-08-07 00:39:25 on dist-test-slave-csg5"
server_key: "98a1a5503b5861f37d13eff8d84af1f3"
server_key_iv: "571be0114d7a9f01e50793cf93d92c6f"
server_key_version: "encryptionkey@0"
I20260807 00:39:25.830619 30609 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:25.831703 30624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:25.831936 30609 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:25.832052 30609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "e9ba79389e67452fa257089422af4efc"
format_stamp: "Formatted at 2026-08-07 00:39:25 on dist-test-slave-csg5"
server_key: "98a1a5503b5861f37d13eff8d84af1f3"
server_key_iv: "571be0114d7a9f01e50793cf93d92c6f"
server_key_version: "encryptionkey@0"
I20260807 00:39:25.832135 30609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:25.836089 30609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:25.838644 30609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:25.838912 30609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:25.844108 30609 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38905
I20260807 00:39:25.844141 30678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38905 every 8 connection(s)
I20260807 00:39:25.844586 30609 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:25.845675 30679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:25.848258 30679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc: Bootstrap starting.
I20260807 00:39:25.848935 30679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:25.849291 30679 log.cc:824] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:25.849337 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30609
I20260807 00:39:25.849460 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:25.849655 8176 external_mini_cluster.cc:1428] Setting key b28b8f7a11724bd95739c5d2f260dbd9
I20260807 00:39:25.850163 30679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc: No bootstrap required, opened a new log
I20260807 00:39:25.852059 30679 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba79389e67452fa257089422af4efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38905 } }
I20260807 00:39:25.852234 30679 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:25.852303 30679 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9ba79389e67452fa257089422af4efc, State: Initialized, Role: FOLLOWER
I20260807 00:39:25.852458 30679 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba79389e67452fa257089422af4efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38905 } }
I20260807 00:39:25.852620 30679 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:25.852674 30679 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:25.852716 30679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:25.853555 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:25.850241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:38797 (local address 127.0.0.1:38905)
0807 00:39:25.850463 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:25.850473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:25.850512 (+ 39us) server_negotiation.cc:407] Connection header received
0807 00:39:25.852059 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:25.852067 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:25.852104 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:25.852288 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:25.853090 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:25.853094 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:25.853094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:25.853098 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:25.853149 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:25.853161 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:25.853232 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:25.853312 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 00:39:25.853359 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260807 00:39:25.853897 30679 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba79389e67452fa257089422af4efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38905 } }
I20260807 00:39:25.854012 30679 leader_election.cc:302] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9ba79389e67452fa257089422af4efc; no voters:
I20260807 00:39:25.854176 30679 leader_election.cc:288] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:25.854265 30686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:25.854450 30686 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [term 1 LEADER]: Becoming Leader. State: Replica: e9ba79389e67452fa257089422af4efc, State: Running, Role: LEADER
I20260807 00:39:25.854516 30679 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:25.854671 30686 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba79389e67452fa257089422af4efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38905 } }
I20260807 00:39:25.854876 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:25.856031 30688 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9ba79389e67452fa257089422af4efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba79389e67452fa257089422af4efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38905 } } }
I20260807 00:39:25.856132 30688 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:25.856498 30687 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ba79389e67452fa257089422af4efc. Latest consensus state: current_term: 1 leader_uuid: "e9ba79389e67452fa257089422af4efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba79389e67452fa257089422af4efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38905 } } }
W20260807 00:39:25.856642 30702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:25.856709 30702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:25.856638 30687 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:25.856787 30706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:25.857002 30706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:25.858438 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:25.857048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.95:39023 (local address 127.0.0.1:38905)
0807 00:39:25.857093 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:25.857095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:25.857272 (+ 177us) server_negotiation.cc:407] Connection header received
0807 00:39:25.857350 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:25.857351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:25.857358 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:25.857418 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:25.858125 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:25.858127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:25.858127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:25.858132 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:25.858149 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:25.858154 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:25.858219 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:25.858347 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 00:39:25.858367 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:25.859038 30706 catalog_manager.cc:1347] Generated new cluster ID: 6b1f6bce1e334264ba67c51463b0c900
I20260807 00:39:25.859103 30706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:25.869674 30706 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:25.869890 30706 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:25.874228 30706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9ba79389e67452fa257089422af4efc: Generated new TSK 0
I20260807 00:39:25.874490 30706 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:25.882153 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30609
2026-08-07T00:39:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:25 dist-test-slave-csg5 krb5kdc[30712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:25 dist-test-slave-csg5 krb5kdc[30712](info): set up 2 sockets
Aug 07 00:39:25 dist-test-slave-csg5 krb5kdc[30712](info): commencing operation
krb5kdc: starting...
W20260807 00:39:27.020758 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:27 dist-test-slave-csg5 krb5kdc[30712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:27.166263 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44311
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:34227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:44311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:27.254575 30727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:27.254923 30727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:27.254979 30727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:27.256448 30727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:27.256553 30727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:27.256582 30727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:27.256603 30727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:27.256628 30727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:27.259097 30727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:34227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:44311
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:44311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:27.259554 30727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:27.259896 30727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:27.265925 30735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:27.265997 30732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:27.266000 30733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:27.266247 30727 server_base.cc:1034] running on GCE node
I20260807 00:39:27.266535 30727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:27.266971 30727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:27.268139 30727 hybrid_clock.cc:648] HybridClock initialized: now 1786063167268102 us; error 51 us; skew 500 ppm
Aug 07 00:39:27 dist-test-slave-csg5 krb5kdc[30712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063167, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:27.271214 30727 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:27.271754 30727 webserver.cc:460] Webserver started at http://127.7.252.62:46231/ using document root <none> and password file <none>
I20260807 00:39:27.271993 30727 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:27.272042 30727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:27.272145 30727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:27.273350 30727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "35c77f6fb5544aa391b30b9ed06de015"
format_stamp: "Formatted at 2026-08-07 00:39:27 on dist-test-slave-csg5"
server_key: "89210dac703bfc222010fc3e804d264b"
server_key_iv: "ed765c58b9c6fa74ca2fc70a5c863917"
server_key_version: "encryptionkey@0"
I20260807 00:39:27.273686 30727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "35c77f6fb5544aa391b30b9ed06de015"
format_stamp: "Formatted at 2026-08-07 00:39:27 on dist-test-slave-csg5"
server_key: "89210dac703bfc222010fc3e804d264b"
server_key_iv: "ed765c58b9c6fa74ca2fc70a5c863917"
server_key_version: "encryptionkey@0"
I20260807 00:39:27.275238 30727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:27.276064 30743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:27.276288 30727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:27.276372 30727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "35c77f6fb5544aa391b30b9ed06de015"
format_stamp: "Formatted at 2026-08-07 00:39:27 on dist-test-slave-csg5"
server_key: "89210dac703bfc222010fc3e804d264b"
server_key_iv: "ed765c58b9c6fa74ca2fc70a5c863917"
server_key_version: "encryptionkey@0"
I20260807 00:39:27.276468 30727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:27.299134 30727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:27.301599 30727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:27.301788 30727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:27.306807 30727 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:44311
I20260807 00:39:27.306859 30800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:44311 every 8 connection(s)
I20260807 00:39:27.307274 30727 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:27.308311 30801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:27.310899 30801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015: Bootstrap starting.
I20260807 00:39:27.311532 30801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:27.311851 30801 log.cc:824] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:27.312901 30801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015: No bootstrap required, opened a new log
I20260807 00:39:27.312983 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30727
I20260807 00:39:27.313194 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:27.313423 8176 external_mini_cluster.cc:1428] Setting key a30b27865a11d6080a3ad614aa670c61
I20260807 00:39:27.316111 30801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c77f6fb5544aa391b30b9ed06de015" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44311 } }
I20260807 00:39:27.316324 30801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:27.316372 30801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c77f6fb5544aa391b30b9ed06de015, State: Initialized, Role: FOLLOWER
I20260807 00:39:27.316546 30801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c77f6fb5544aa391b30b9ed06de015" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44311 } }
I20260807 00:39:27.316620 30801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:27.316645 30801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:27.316748 30801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:27.317543 30801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c77f6fb5544aa391b30b9ed06de015" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44311 } }
I20260807 00:39:27.317672 30801 leader_election.cc:302] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35c77f6fb5544aa391b30b9ed06de015; no voters:
I20260807 00:39:27.317873 30801 leader_election.cc:288] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:27.317936 30807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:27.318113 30807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [term 1 LEADER]: Becoming Leader. State: Replica: 35c77f6fb5544aa391b30b9ed06de015, State: Running, Role: LEADER
I20260807 00:39:27.318158 30801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:27.318264 30807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c77f6fb5544aa391b30b9ed06de015" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44311 } }
I20260807 00:39:27.318717 30809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35c77f6fb5544aa391b30b9ed06de015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c77f6fb5544aa391b30b9ed06de015" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44311 } } }
I20260807 00:39:27.318717 30810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35c77f6fb5544aa391b30b9ed06de015. Latest consensus state: current_term: 1 leader_uuid: "35c77f6fb5544aa391b30b9ed06de015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c77f6fb5544aa391b30b9ed06de015" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 44311 } } }
I20260807 00:39:27.318825 30809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:27.318858 30810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:27.319103 30816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:27.319651 30816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:27.322077 30816 catalog_manager.cc:1347] Generated new cluster ID: 964849a6b29649f9a8d10f54779576ed
I20260807 00:39:27.322137 30816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 00:39:27 dist-test-slave-csg5 krb5kdc[30712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:27.328083 30806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:27.314062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34851 (local address 127.7.252.62:44311)
0807 00:39:27.314290 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:27.314301 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:27.314337 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:39:27.316053 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:27.316064 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:27.316148 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:27.316338 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:27.317223 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:27.318994 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:27.320060 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:27.320640 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:27.320771 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:27.324092 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:27.324096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:27.324096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:27.324109 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:27.326138 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:27.326692 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:27.326695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:27.326695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:27.326802 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:27.327101 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:27.327102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:27.327102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:27.327407 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:27.327548 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:27.327766 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 00:39:27.327866 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":206,"threads_started":1}
I20260807 00:39:27.328526 30816 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:27.329154 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:27.329267 30816 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:27.333576 30816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35c77f6fb5544aa391b30b9ed06de015: Generated new TSK 0
I20260807 00:39:27.333779 30816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:27.341198 30806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:27.333376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43049 (local address 127.7.252.62:44311)
0807 00:39:27.333415 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:27.333417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:27.333749 (+ 332us) server_negotiation.cc:407] Connection header received
0807 00:39:27.333865 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:27.333866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:27.333879 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:27.333953 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:27.334494 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:27.335442 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:27.336225 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:27.336604 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:27.336684 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:27.338094 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:27.338096 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:27.338096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:27.338104 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:27.339830 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:27.340216 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:27.340217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:27.340218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:27.340299 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:27.340525 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:27.340526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:27.340527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:27.340674 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:27.340793 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:27.340996 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 00:39:27.341071 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:39:27.343760 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30727
W20260807 00:39:27.351217 30710 connection.cc:535] client connection to 127.7.252.62:44311 recv error: Network error: failed to read from TLS socket (remote: 127.7.252.62:44311): Connection reset by peer (error 104)
2026-08-07T00:39:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:27 dist-test-slave-csg5 krb5kdc[30838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:27 dist-test-slave-csg5 krb5kdc[30838](info): set up 2 sockets
Aug 07 00:39:27 dist-test-slave-csg5 krb5kdc[30838](info): commencing operation
krb5kdc: starting...
W20260807 00:39:28.448715 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:28 dist-test-slave-csg5 krb5kdc[30838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:28.590611 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:39295
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:42077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:39295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:28.677018 30852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:28.677240 30852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:28.677265 30852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:28.678473 30852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:28.678519 30852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:28.678534 30852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:28.678546 30852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:28.678558 30852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:28.680143 30852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:42077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:39295
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:39295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:28.680446 30852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:28.680699 30852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:28.686223 30860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:28.686375 30858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:28.686252 30857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:28.686583 30852 server_base.cc:1034] running on GCE node
I20260807 00:39:28.686877 30852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:28.687215 30852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:28.688433 30852 hybrid_clock.cc:648] HybridClock initialized: now 1786063168688408 us; error 34 us; skew 500 ppm
Aug 07 00:39:28 dist-test-slave-csg5 krb5kdc[30838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063168, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:28.696360 30852 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:28.697103 30852 webserver.cc:460] Webserver started at http://127.7.252.62:35655/ using document root <none> and password file <none>
I20260807 00:39:28.697413 30852 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:28.697499 30852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:28.697696 30852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:28.699093 30852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "29cbd0d3cd5047fe9247f228f3266a57"
format_stamp: "Formatted at 2026-08-07 00:39:28 on dist-test-slave-csg5"
server_key: "54f2f530fce9f3c6fe50a1ae4d993013"
server_key_iv: "bc67bdc2db5e81f82fab14ef097516ef"
server_key_version: "encryptionkey@0"
I20260807 00:39:28.699541 30852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "29cbd0d3cd5047fe9247f228f3266a57"
format_stamp: "Formatted at 2026-08-07 00:39:28 on dist-test-slave-csg5"
server_key: "54f2f530fce9f3c6fe50a1ae4d993013"
server_key_iv: "bc67bdc2db5e81f82fab14ef097516ef"
server_key_version: "encryptionkey@0"
I20260807 00:39:28.701270 30852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 00:39:28.702246 30868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:28.702497 30852 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:28.702611 30852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "29cbd0d3cd5047fe9247f228f3266a57"
format_stamp: "Formatted at 2026-08-07 00:39:28 on dist-test-slave-csg5"
server_key: "54f2f530fce9f3c6fe50a1ae4d993013"
server_key_iv: "bc67bdc2db5e81f82fab14ef097516ef"
server_key_version: "encryptionkey@0"
I20260807 00:39:28.702734 30852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:28.719231 30852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:28.721813 30852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:28.722007 30852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:28.727188 30852 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:39295
I20260807 00:39:28.727280 30926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:39295 every 8 connection(s)
I20260807 00:39:28.727677 30852 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:28.728754 30927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:28.731338 30927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57: Bootstrap starting.
I20260807 00:39:28.731948 30927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:28.732229 30927 log.cc:824] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:28.733026 30927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57: No bootstrap required, opened a new log
I20260807 00:39:28.735003 30927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29cbd0d3cd5047fe9247f228f3266a57" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39295 } }
I20260807 00:39:28.735164 30927 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:28.735189 30927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cbd0d3cd5047fe9247f228f3266a57, State: Initialized, Role: FOLLOWER
I20260807 00:39:28.735316 30927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29cbd0d3cd5047fe9247f228f3266a57" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39295 } }
I20260807 00:39:28.735417 30927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:28.735461 30927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:28.735545 30927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:28.736721 30927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29cbd0d3cd5047fe9247f228f3266a57" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39295 } }
I20260807 00:39:28.736896 30927 leader_election.cc:302] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29cbd0d3cd5047fe9247f228f3266a57; no voters:
I20260807 00:39:28.737134 30927 leader_election.cc:288] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:28.737206 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30852
I20260807 00:39:28.737254 30930 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:28.737339 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:28.737468 30930 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [term 1 LEADER]: Becoming Leader. State: Replica: 29cbd0d3cd5047fe9247f228f3266a57, State: Running, Role: LEADER
I20260807 00:39:28.737542 30927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:28.737571 8176 external_mini_cluster.cc:1428] Setting key 7ed8df1ad6c3d9ecd47a8b8467b31a39
I20260807 00:39:28.737566 30930 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29cbd0d3cd5047fe9247f228f3266a57" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39295 } }
I20260807 00:39:28.738037 30931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29cbd0d3cd5047fe9247f228f3266a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29cbd0d3cd5047fe9247f228f3266a57" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39295 } } }
I20260807 00:39:28.738159 30931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:28.738355 30932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29cbd0d3cd5047fe9247f228f3266a57. Latest consensus state: current_term: 1 leader_uuid: "29cbd0d3cd5047fe9247f228f3266a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29cbd0d3cd5047fe9247f228f3266a57" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39295 } } }
I20260807 00:39:28.738433 30932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:28.738847 30940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:28.739573 30940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:28.741693 30940 catalog_manager.cc:1347] Generated new cluster ID: 621d187de1a946039f672394942ed181
I20260807 00:39:28.741779 30940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:28.744927 30943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:28.738358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50469 (local address 127.7.252.62:39295)
0807 00:39:28.738586 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:28.738597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:28.738638 (+ 41us) server_negotiation.cc:407] Connection header received
0807 00:39:28.738829 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:28.738838 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:28.738908 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:28.739400 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:28.739562 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:28.741013 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:28.742286 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:28.743055 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:28.743178 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:28.744105 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:28.744110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:28.744110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:28.744359 (+ 249us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:28.744400 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:28.744416 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:28.744501 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:28.744655 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 00:39:28.744690 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":76,"threads_started":1}
I20260807 00:39:28.746133 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:28.752110 30943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:28.748011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41363 (local address 127.7.252.62:39295)
0807 00:39:28.748052 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:28.748054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:28.748178 (+ 124us) server_negotiation.cc:407] Connection header received
0807 00:39:28.748254 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:28.748255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:28.748282 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:28.748345 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:28.748534 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:28.749364 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:28.750548 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:28.750939 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:28.751007 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:28.751804 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:28.751805 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:28.751806 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:28.751812 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:28.751831 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:28.751837 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:28.751903 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:28.752003 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 00:39:28.752018 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:39:28.762928 30940 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:28.763823 30940 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:28.769871 30940 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29cbd0d3cd5047fe9247f228f3266a57: Generated new TSK 0
I20260807 00:39:28.770107 30940 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:28.777439 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30852
W20260807 00:39:28.785315 30836 connection.cc:535] client connection to 127.7.252.62:39295 recv error: Network error: failed to read from TLS socket (remote: 127.7.252.62:39295): Connection reset by peer (error 104)
2026-08-07T00:39:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:28 dist-test-slave-csg5 krb5kdc[30962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:28 dist-test-slave-csg5 krb5kdc[30962](info): set up 2 sockets
Aug 07 00:39:28 dist-test-slave-csg5 krb5kdc[30962](info): commencing operation
krb5kdc: starting...
W20260807 00:39:29.933880 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:30 dist-test-slave-csg5 krb5kdc[30962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:30.083997 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:40947
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:40947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:30.175983 30976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:30.176223 30976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:30.176257 30976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:30.177466 30976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:30.177511 30976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:30.177525 30976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:30.177539 30976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:30.177554 30976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:30.179279 30976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:40947
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:40947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:30.179577 30976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:30.179803 30976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:30.185307 30986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:30.185467 30984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:30.185310 30982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:30.185647 30976 server_base.cc:1034] running on GCE node
I20260807 00:39:30.185967 30976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:30.186280 30976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:30.187463 30976 hybrid_clock.cc:648] HybridClock initialized: now 1786063170187454 us; error 51 us; skew 500 ppm
Aug 07 00:39:30 dist-test-slave-csg5 krb5kdc[30962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063170, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:30.190289 30976 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:30.190775 30976 webserver.cc:460] Webserver started at http://127.7.252.62:42109/ using document root <none> and password file <none>
I20260807 00:39:30.191035 30976 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:30.191084 30976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:30.191221 30976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:30.192364 30976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "3b70777a21b8456dbba13ac89ef53a67"
format_stamp: "Formatted at 2026-08-07 00:39:30 on dist-test-slave-csg5"
server_key: "a278e32f85d23cea56d8e67a2ee34c4d"
server_key_iv: "8d68942126b5e6ad3e7e40108dd6e455"
server_key_version: "encryptionkey@0"
I20260807 00:39:30.192740 30976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "3b70777a21b8456dbba13ac89ef53a67"
format_stamp: "Formatted at 2026-08-07 00:39:30 on dist-test-slave-csg5"
server_key: "a278e32f85d23cea56d8e67a2ee34c4d"
server_key_iv: "8d68942126b5e6ad3e7e40108dd6e455"
server_key_version: "encryptionkey@0"
I20260807 00:39:30.194149 30976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:30.195118 30994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:30.195397 30976 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:30.195516 30976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "3b70777a21b8456dbba13ac89ef53a67"
format_stamp: "Formatted at 2026-08-07 00:39:30 on dist-test-slave-csg5"
server_key: "a278e32f85d23cea56d8e67a2ee34c4d"
server_key_iv: "8d68942126b5e6ad3e7e40108dd6e455"
server_key_version: "encryptionkey@0"
I20260807 00:39:30.195595 30976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:30.199738 30976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:30.202353 30976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:30.202569 30976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:30.207405 30976 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:40947
I20260807 00:39:30.207445 31049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:40947 every 8 connection(s)
I20260807 00:39:30.207844 30976 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:30.208928 31050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:30.210724 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 30976
I20260807 00:39:30.210872 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:30.211090 8176 external_mini_cluster.cc:1428] Setting key 8852c905aff816c07cf2cc5004c96667
I20260807 00:39:30.211870 31050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67: Bootstrap starting.
I20260807 00:39:30.212575 31050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:30.213145 31050 log.cc:824] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:30.214023 31050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67: No bootstrap required, opened a new log
I20260807 00:39:30.214318 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:30.211778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48573 (local address 127.7.252.62:40947)
0807 00:39:30.212015 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:30.212027 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:30.212065 (+ 38us) server_negotiation.cc:407] Connection header received
0807 00:39:30.212594 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:30.212601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:30.212631 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:30.212822 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:30.213631 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:30.213634 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:30.213635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:30.213639 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:30.213681 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:30.213693 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:30.213845 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:30.213924 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 00:39:30.213972 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":106,"threads_started":1}
I20260807 00:39:30.215590 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:30.216686 31050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b70777a21b8456dbba13ac89ef53a67" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40947 } }
I20260807 00:39:30.216887 31050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:30.216938 31050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b70777a21b8456dbba13ac89ef53a67, State: Initialized, Role: FOLLOWER
I20260807 00:39:30.217072 31050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b70777a21b8456dbba13ac89ef53a67" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40947 } }
I20260807 00:39:30.217170 31050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:30.217232 31050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:30.217288 31050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:30.218020 31050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b70777a21b8456dbba13ac89ef53a67" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40947 } }
I20260807 00:39:30.218159 31050 leader_election.cc:302] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b70777a21b8456dbba13ac89ef53a67; no voters:
I20260807 00:39:30.218374 31050 leader_election.cc:288] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:30.218395 31060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:30.218513 31060 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [term 1 LEADER]: Becoming Leader. State: Replica: 3b70777a21b8456dbba13ac89ef53a67, State: Running, Role: LEADER
I20260807 00:39:30.218693 31050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:30.218628 31060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b70777a21b8456dbba13ac89ef53a67" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40947 } }
I20260807 00:39:30.218621 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:30.217213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54987 (local address 127.7.252.62:40947)
0807 00:39:30.217257 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:30.217260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:30.217396 (+ 136us) server_negotiation.cc:407] Connection header received
0807 00:39:30.217461 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:30.217461 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:30.217466 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:30.217533 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:30.218373 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:30.218374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:30.218375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:30.218380 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:30.218395 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:30.218400 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:30.218452 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:30.218532 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 00:39:30.218549 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:39:30.219115 31061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b70777a21b8456dbba13ac89ef53a67. Latest consensus state: current_term: 1 leader_uuid: "3b70777a21b8456dbba13ac89ef53a67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b70777a21b8456dbba13ac89ef53a67" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40947 } } }
I20260807 00:39:30.219129 31062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b70777a21b8456dbba13ac89ef53a67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b70777a21b8456dbba13ac89ef53a67" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 40947 } } }
I20260807 00:39:30.219218 31061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:30.219244 31062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:30.220288 31066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:30.220799 31066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:30.222769 31066 catalog_manager.cc:1347] Generated new cluster ID: b05f1fa005d54ed49f58a28d89fcf25a
I20260807 00:39:30.222832 31066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:30.238039 31066 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:30.238255 31066 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:30.245651 31066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b70777a21b8456dbba13ac89ef53a67: Generated new TSK 0
I20260807 00:39:30.245956 31066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:30.256289 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 30976
2026-08-07T00:39:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:30 dist-test-slave-csg5 krb5kdc[31081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:30 dist-test-slave-csg5 krb5kdc[31081](info): set up 2 sockets
Aug 07 00:39:30 dist-test-slave-csg5 krb5kdc[31081](info): commencing operation
krb5kdc: starting...
W20260807 00:39:31.368530 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:31 dist-test-slave-csg5 krb5kdc[31081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:31.511474 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:39045
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:36655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:39045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:31.603360 31094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:31.603678 31094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:31.603730 31094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:31.605783 31094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:31.605857 31094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:31.605883 31094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:31.605903 31094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:31.605921 31094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:31.608681 31094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:36655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:39045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:39045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:31.609019 31094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:31.609316 31094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:39:31.614995 31094 server_base.cc:1034] running on GCE node
W20260807 00:39:31.614956 31103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:31.614962 31099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:31.614956 31100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:31.615409 31094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:31.615731 31094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:31.616914 31094 hybrid_clock.cc:648] HybridClock initialized: now 1786063171616899 us; error 32 us; skew 500 ppm
Aug 07 00:39:31 dist-test-slave-csg5 krb5kdc[31081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063171, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:31.619628 31094 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:31.620121 31094 webserver.cc:460] Webserver started at http://127.7.252.62:43569/ using document root <none> and password file <none>
I20260807 00:39:31.620380 31094 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:31.620437 31094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:31.620579 31094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:31.621719 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "4b55818d0364425b8e9261efa66dd5a0"
format_stamp: "Formatted at 2026-08-07 00:39:31 on dist-test-slave-csg5"
server_key: "fd742f811b74c22e46a52f2f59fd379a"
server_key_iv: "73b31b023fb852c75f455a36eaa6eeae"
server_key_version: "encryptionkey@0"
I20260807 00:39:31.622102 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "4b55818d0364425b8e9261efa66dd5a0"
format_stamp: "Formatted at 2026-08-07 00:39:31 on dist-test-slave-csg5"
server_key: "fd742f811b74c22e46a52f2f59fd379a"
server_key_iv: "73b31b023fb852c75f455a36eaa6eeae"
server_key_version: "encryptionkey@0"
I20260807 00:39:31.623647 31094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:31.624724 31110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:31.624971 31094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:31.625061 31094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "4b55818d0364425b8e9261efa66dd5a0"
format_stamp: "Formatted at 2026-08-07 00:39:31 on dist-test-slave-csg5"
server_key: "fd742f811b74c22e46a52f2f59fd379a"
server_key_iv: "73b31b023fb852c75f455a36eaa6eeae"
server_key_version: "encryptionkey@0"
I20260807 00:39:31.625124 31094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:31.636842 31094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:31.639645 31094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:31.639796 31094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:31.644580 31094 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:39045
I20260807 00:39:31.644717 31167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:39045 every 8 connection(s)
I20260807 00:39:31.645211 31094 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:31.646404 31168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:31.648306 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31094
I20260807 00:39:31.648420 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:31.648655 8176 external_mini_cluster.cc:1428] Setting key d75e05ab315ee8046c8f050573d71db0
I20260807 00:39:31.649528 31168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0: Bootstrap starting.
I20260807 00:39:31.650233 31168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:31.650678 31168 log.cc:824] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:31.652789 31168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0: No bootstrap required, opened a new log
I20260807 00:39:31.655673 31168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b55818d0364425b8e9261efa66dd5a0" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39045 } }
I20260807 00:39:31.655891 31168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:31.655938 31168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b55818d0364425b8e9261efa66dd5a0, State: Initialized, Role: FOLLOWER
I20260807 00:39:31.656102 31168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b55818d0364425b8e9261efa66dd5a0" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39045 } }
I20260807 00:39:31.656200 31168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:31.656231 31168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:31.656273 31168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 00:39:31 dist-test-slave-csg5 krb5kdc[31081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:31.657006 31168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b55818d0364425b8e9261efa66dd5a0" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39045 } }
I20260807 00:39:31.657142 31168 leader_election.cc:302] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b55818d0364425b8e9261efa66dd5a0; no voters:
I20260807 00:39:31.657388 31168 leader_election.cc:288] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:31.657424 31173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:31.657661 31173 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b55818d0364425b8e9261efa66dd5a0, State: Running, Role: LEADER
I20260807 00:39:31.657709 31168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:31.657804 31173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b55818d0364425b8e9261efa66dd5a0" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39045 } }
I20260807 00:39:31.658186 31173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b55818d0364425b8e9261efa66dd5a0. Latest consensus state: current_term: 1 leader_uuid: "4b55818d0364425b8e9261efa66dd5a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b55818d0364425b8e9261efa66dd5a0" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39045 } } }
I20260807 00:39:31.658463 31173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:31.658370 31174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b55818d0364425b8e9261efa66dd5a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b55818d0364425b8e9261efa66dd5a0" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 39045 } } }
I20260807 00:39:31.658912 31174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:31.659139 31182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:31.659686 31182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:31.661667 31182 catalog_manager.cc:1347] Generated new cluster ID: 15ba4b658ac64a4bb2c62989ee470d01
I20260807 00:39:31.661731 31182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:31.661998 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:31.649284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41293 (local address 127.7.252.62:39045)
0807 00:39:31.649503 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:31.649512 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:31.649542 (+ 30us) server_negotiation.cc:407] Connection header received
0807 00:39:31.650093 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:31.650101 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:31.650155 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:31.650295 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:31.651279 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:31.652293 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:31.653466 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:31.653951 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:31.654063 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:31.657380 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:31.657385 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:31.657385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:31.657407 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:31.660118 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:31.660604 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:31.660607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:31.660608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:31.660727 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:31.660959 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:31.660960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:31.660961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:31.661329 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:31.661505 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:31.661628 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 00:39:31.661794 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
I20260807 00:39:31.668402 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:31.671777 31182 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:31.672428 31182 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:31.676256 31182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b55818d0364425b8e9261efa66dd5a0: Generated new TSK 0
I20260807 00:39:31.676489 31182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:31.679755 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:31.669949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36183 (local address 127.7.252.62:39045)
0807 00:39:31.669998 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:31.670000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:31.670988 (+ 988us) server_negotiation.cc:407] Connection header received
0807 00:39:31.671077 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:31.671079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:31.671092 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:31.671171 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:31.672021 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:31.672940 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:31.674081 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:31.674460 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:31.674540 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:31.676209 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:31.676210 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:31.676211 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:31.676219 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:31.678194 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:31.678795 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:31.678796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:31.678796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:31.678863 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:31.679080 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:31.679081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:31.679081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:31.679231 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:31.679342 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:31.679530 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 00:39:31.679639 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:39:31.682017 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31094
2026-08-07T00:39:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:31 dist-test-slave-csg5 krb5kdc[31199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:31 dist-test-slave-csg5 krb5kdc[31199](info): set up 2 sockets
Aug 07 00:39:31 dist-test-slave-csg5 krb5kdc[31199](info): commencing operation
krb5kdc: starting...
W20260807 00:39:32.827322 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:32 dist-test-slave-csg5 krb5kdc[31199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:33.003492 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:34679
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:34679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:33.094480 31212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:33.094784 31212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:33.094816 31212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:33.095984 31212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:33.096026 31212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:33.096040 31212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:33.096055 31212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:33.096066 31212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:33.097575 31212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:34679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:34679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:33.097788 31212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:33.097983 31212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:33.103099 31220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:33.103219 31212 server_base.cc:1034] running on GCE node
W20260807 00:39:33.103078 31218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:33.103427 31217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:33.103696 31212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:33.104012 31212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:33.105175 31212 hybrid_clock.cc:648] HybridClock initialized: now 1786063173105163 us; error 31 us; skew 500 ppm
Aug 07 00:39:33 dist-test-slave-csg5 krb5kdc[31199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063173, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:33.107828 31212 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:33.108323 31212 webserver.cc:460] Webserver started at http://127.7.252.62:34985/ using document root <none> and password file <none>
I20260807 00:39:33.108582 31212 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:33.108652 31212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:33.108811 31212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:33.109920 31212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "36e0b729da03499aae1baa1b20d662da"
format_stamp: "Formatted at 2026-08-07 00:39:33 on dist-test-slave-csg5"
server_key: "a4c209a4fa6347fb0d61cb6a79535159"
server_key_iv: "8cfdf0d02b47d3f2a8a9b8db632359e4"
server_key_version: "encryptionkey@0"
I20260807 00:39:33.110288 31212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "36e0b729da03499aae1baa1b20d662da"
format_stamp: "Formatted at 2026-08-07 00:39:33 on dist-test-slave-csg5"
server_key: "a4c209a4fa6347fb0d61cb6a79535159"
server_key_iv: "8cfdf0d02b47d3f2a8a9b8db632359e4"
server_key_version: "encryptionkey@0"
I20260807 00:39:33.111840 31212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:33.112799 31227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:33.113023 31212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:33.113147 31212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "36e0b729da03499aae1baa1b20d662da"
format_stamp: "Formatted at 2026-08-07 00:39:33 on dist-test-slave-csg5"
server_key: "a4c209a4fa6347fb0d61cb6a79535159"
server_key_iv: "8cfdf0d02b47d3f2a8a9b8db632359e4"
server_key_version: "encryptionkey@0"
I20260807 00:39:33.113240 31212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:33.132195 31212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:33.134406 31212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:33.134588 31212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:33.139295 31212 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:34679
I20260807 00:39:33.139333 31282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:34679 every 8 connection(s)
I20260807 00:39:33.139855 31212 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:33.140838 31283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:33.143427 31283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da: Bootstrap starting.
I20260807 00:39:33.144068 31283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:33.144371 31283 log.cc:824] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:33.145221 31283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da: No bootstrap required, opened a new log
I20260807 00:39:33.147058 31283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36e0b729da03499aae1baa1b20d662da" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34679 } }
I20260807 00:39:33.147219 31283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:33.147243 31283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36e0b729da03499aae1baa1b20d662da, State: Initialized, Role: FOLLOWER
I20260807 00:39:33.147413 31283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36e0b729da03499aae1baa1b20d662da" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34679 } }
I20260807 00:39:33.147485 31283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:33.147506 31283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:33.147534 31283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:33.148550 31283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36e0b729da03499aae1baa1b20d662da" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34679 } }
I20260807 00:39:33.148643 31283 leader_election.cc:302] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36e0b729da03499aae1baa1b20d662da; no voters:
I20260807 00:39:33.148828 31283 leader_election.cc:288] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:33.148926 31286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:33.149113 31283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:33.149124 31286 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [term 1 LEADER]: Becoming Leader. State: Replica: 36e0b729da03499aae1baa1b20d662da, State: Running, Role: LEADER
I20260807 00:39:33.149366 31286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36e0b729da03499aae1baa1b20d662da" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34679 } }
I20260807 00:39:33.149801 31287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36e0b729da03499aae1baa1b20d662da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36e0b729da03499aae1baa1b20d662da" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34679 } } }
I20260807 00:39:33.149799 31288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36e0b729da03499aae1baa1b20d662da. Latest consensus state: current_term: 1 leader_uuid: "36e0b729da03499aae1baa1b20d662da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36e0b729da03499aae1baa1b20d662da" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 34679 } } }
I20260807 00:39:33.149930 31287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:33.149936 31288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:33.150107 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31212
I20260807 00:39:33.150218 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:33.150216 31295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:33.150434 8176 external_mini_cluster.cc:1428] Setting key 8ee8238ed0496dd1274be14053797b73
I20260807 00:39:33.150797 31295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:33.152486 31295 catalog_manager.cc:1347] Generated new cluster ID: 57fdef3f20254f05939ad6bad4dfac08
I20260807 00:39:33.152544 31295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:33.156455 31303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:33.151148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60509 (local address 127.7.252.62:34679)
0807 00:39:33.151343 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:33.151363 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:33.151559 (+ 196us) server_negotiation.cc:407] Connection header received
0807 00:39:33.151709 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:33.151717 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:33.151777 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:33.151934 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:33.152371 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:33.153457 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:33.154300 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:33.154909 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:33.155047 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:33.155792 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:33.155796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:33.155796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:33.155988 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:33.156022 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:33.156034 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:33.156113 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:33.156189 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 00:39:33.156259 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":139,"thread_start_us":70,"threads_started":1}
I20260807 00:39:33.157518 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:33.162034 31303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:33.158953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52295 (local address 127.7.252.62:34679)
0807 00:39:33.158995 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:33.158996 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:33.159230 (+ 234us) server_negotiation.cc:407] Connection header received
0807 00:39:33.159294 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:33.159295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:33.159306 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:33.159354 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:33.159497 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:33.159975 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:33.160686 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:33.160905 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:33.160990 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:33.161715 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:33.161717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:33.161717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:33.161749 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:33.161764 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:33.161768 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:33.161847 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:33.161909 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 00:39:33.161936 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:39:33.184226 31295 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:33.184993 31295 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:33.198863 31295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36e0b729da03499aae1baa1b20d662da: Generated new TSK 0
I20260807 00:39:33.199098 31295 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:33.205260 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31212
2026-08-07T00:39:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1523 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:33 dist-test-slave-csg5 krb5kdc[31316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:33 dist-test-slave-csg5 krb5kdc[31316](info): set up 2 sockets
Aug 07 00:39:33 dist-test-slave-csg5 krb5kdc[31316](info): commencing operation
krb5kdc: starting...
W20260807 00:39:34.305119 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:34 dist-test-slave-csg5 krb5kdc[31316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:34.442646 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:37427
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:42649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:37427
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:34.530969 31330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:34.531229 31330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:34.531271 31330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:34.532518 31330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:34.532596 31330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:34.532624 31330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:34.532657 31330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:34.532683 31330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:34.534710 31330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:42649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:37427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:37427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:34.535019 31330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:34.535274 31330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:34.541090 31338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:34.541042 31336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:34.541067 31330 server_base.cc:1034] running on GCE node
W20260807 00:39:34.541095 31335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:34.541646 31330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:34.541991 31330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:34.543201 31330 hybrid_clock.cc:648] HybridClock initialized: now 1786063174543149 us; error 94 us; skew 500 ppm
Aug 07 00:39:34 dist-test-slave-csg5 krb5kdc[31316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063174, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:34.551226 31330 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:34.551802 31330 webserver.cc:460] Webserver started at http://127.7.252.62:43851/ using document root <none> and password file <none>
I20260807 00:39:34.552070 31330 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:34.552150 31330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:34.552331 31330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:34.553619 31330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "712827210cb74581a6ab9800d40f9fa9"
format_stamp: "Formatted at 2026-08-07 00:39:34 on dist-test-slave-csg5"
server_key: "498a4b1c7d3af8be179f101ecc4e5420"
server_key_iv: "e352629f026c99536218bbfc52d95c18"
server_key_version: "encryptionkey@0"
I20260807 00:39:34.553972 31330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "712827210cb74581a6ab9800d40f9fa9"
format_stamp: "Formatted at 2026-08-07 00:39:34 on dist-test-slave-csg5"
server_key: "498a4b1c7d3af8be179f101ecc4e5420"
server_key_iv: "e352629f026c99536218bbfc52d95c18"
server_key_version: "encryptionkey@0"
I20260807 00:39:34.555594 31330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260807 00:39:34.556630 31345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:34.556913 31330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:34.557027 31330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "712827210cb74581a6ab9800d40f9fa9"
format_stamp: "Formatted at 2026-08-07 00:39:34 on dist-test-slave-csg5"
server_key: "498a4b1c7d3af8be179f101ecc4e5420"
server_key_iv: "e352629f026c99536218bbfc52d95c18"
server_key_version: "encryptionkey@0"
I20260807 00:39:34.557111 31330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:34.561120 31330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:34.563545 31330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:34.563726 31330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:34.568303 31330 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:37427
I20260807 00:39:34.568354 31400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:37427 every 8 connection(s)
I20260807 00:39:34.568732 31330 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:34.569818 31401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:34.572408 31401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9: Bootstrap starting.
I20260807 00:39:34.573047 31401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:34.573359 31401 log.cc:824] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:34.574152 31401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9: No bootstrap required, opened a new log
I20260807 00:39:34.576015 31401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712827210cb74581a6ab9800d40f9fa9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37427 } }
I20260807 00:39:34.576164 31401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 00:39:34.576188 31401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712827210cb74581a6ab9800d40f9fa9, State: Initialized, Role: FOLLOWER
I20260807 00:39:34.576352 31401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712827210cb74581a6ab9800d40f9fa9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37427 } }
I20260807 00:39:34.576423 31401 raft_consensus.cc:388] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 00:39:34.576447 31401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 00:39:34.576519 31401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:34.577454 31401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712827210cb74581a6ab9800d40f9fa9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37427 } }
I20260807 00:39:34.577574 31401 leader_election.cc:302] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 712827210cb74581a6ab9800d40f9fa9; no voters:
I20260807 00:39:34.577777 31401 leader_election.cc:288] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 00:39:34.577848 31404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:34.578074 31401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:34.578078 31404 raft_consensus.cc:686] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [term 1 LEADER]: Becoming Leader. State: Replica: 712827210cb74581a6ab9800d40f9fa9, State: Running, Role: LEADER
I20260807 00:39:34.578253 31404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712827210cb74581a6ab9800d40f9fa9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37427 } }
I20260807 00:39:34.578773 31405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "712827210cb74581a6ab9800d40f9fa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712827210cb74581a6ab9800d40f9fa9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37427 } } }
I20260807 00:39:34.578807 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31330
I20260807 00:39:34.578795 31406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 712827210cb74581a6ab9800d40f9fa9. Latest consensus state: current_term: 1 leader_uuid: "712827210cb74581a6ab9800d40f9fa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712827210cb74581a6ab9800d40f9fa9" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 37427 } } }
I20260807 00:39:34.578943 31405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:34.578960 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:34.578950 31406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:34.579160 8176 external_mini_cluster.cc:1428] Setting key 63a061365710d2943db53a34e6647e0a
I20260807 00:39:34.579195 31413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:34.579738 31413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:34.581990 31413 catalog_manager.cc:1347] Generated new cluster ID: 8cdd18d131e544b5932f1e81ebadae65
I20260807 00:39:34.582062 31413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:34.582181 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:34.579902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48697 (local address 127.7.252.62:37427)
0807 00:39:34.580345 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:34.580354 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:34.580381 (+ 27us) server_negotiation.cc:407] Connection header received
0807 00:39:34.580518 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:34.580526 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:34.580557 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:34.580693 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:34.581544 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:34.581548 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:34.581548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:34.581552 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:34.581591 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:34.581603 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:34.581690 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:34.581760 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 00:39:34.581900 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":92,"threads_started":1}
I20260807 00:39:34.583287 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:34.585904 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:34.584809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45459 (local address 127.7.252.62:37427)
0807 00:39:34.584843 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:34.584845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:34.584937 (+ 92us) server_negotiation.cc:407] Connection header received
0807 00:39:34.585003 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:34.585004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:34.585008 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:34.585067 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:34.585674 (+ 607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:34.585675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:34.585676 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 00:39:34.585680 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:34.585696 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 00:39:34.585701 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:34.585754 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:34.585823 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 00:39:34.585836 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:39:34.590322 31413 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:34.590541 31413 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:34.600420 31413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 712827210cb74581a6ab9800d40f9fa9: Generated new TSK 0
I20260807 00:39:34.600630 31413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:34.604230 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31330
2026-08-07T00:39:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1399 ms)
[----------] 18 tests from AuthTokenIssuingTest (26024 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:34 dist-test-slave-csg5 krb5kdc[31432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:34 dist-test-slave-csg5 krb5kdc[31432](info): set up 2 sockets
Aug 07 00:39:34 dist-test-slave-csg5 krb5kdc[31432](info): commencing operation
krb5kdc: starting...
W20260807 00:39:35.689327 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:35 dist-test-slave-csg5 krb5kdc[31432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:35.831399 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41911
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41911,127.7.252.61:35303,127.7.252.60:35151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:35.920006 31445 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 00:39:35.920262 31445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:35.920282 31445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:35.920305 31445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:35.921453 31445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:35.921490 31445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:35.921504 31445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:35.921517 31445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:35.921530 31445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:35.923087 31445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41911,127.7.252.61:35303,127.7.252.60:35151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:41911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:35.923326 31445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:35.923514 31445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:35.929203 31451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:35.929517 31450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:35.929205 31453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:35.929586 31445 server_base.cc:1034] running on GCE node
I20260807 00:39:35.930079 31445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:35.930415 31445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:35.931631 31445 hybrid_clock.cc:648] HybridClock initialized: now 1786063175931604 us; error 52 us; skew 500 ppm
Aug 07 00:39:35 dist-test-slave-csg5 krb5kdc[31432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:35.935593 31445 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:35.936066 31445 webserver.cc:460] Webserver started at http://127.7.252.62:36645/ using document root <none> and password file <none>
I20260807 00:39:35.936288 31445 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:35.936337 31445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:35.936439 31445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:35.937551 31445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "c9209eb764904ad3806799f228c12962"
format_stamp: "Formatted at 2026-08-07 00:39:35 on dist-test-slave-csg5"
server_key: "3f602c2358f333072f12641373837c8c"
server_key_iv: "3a140c14f1133d3410824f9daa21263d"
server_key_version: "encryptionkey@0"
I20260807 00:39:35.937891 31445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "c9209eb764904ad3806799f228c12962"
format_stamp: "Formatted at 2026-08-07 00:39:35 on dist-test-slave-csg5"
server_key: "3f602c2358f333072f12641373837c8c"
server_key_iv: "3a140c14f1133d3410824f9daa21263d"
server_key_version: "encryptionkey@0"
I20260807 00:39:35.939368 31445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:35.940248 31460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:35.940522 31445 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:35.940665 31445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "c9209eb764904ad3806799f228c12962"
format_stamp: "Formatted at 2026-08-07 00:39:35 on dist-test-slave-csg5"
server_key: "3f602c2358f333072f12641373837c8c"
server_key_iv: "3a140c14f1133d3410824f9daa21263d"
server_key_version: "encryptionkey@0"
I20260807 00:39:35.940755 31445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:35.963059 31445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:35.965831 31445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:35.966063 31445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:35.970985 31445 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:41911
I20260807 00:39:35.971029 31517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:41911 every 8 connection(s)
I20260807 00:39:35.971493 31445 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:35.972611 31518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:35.974332 31518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:35.978070 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31445
I20260807 00:39:35.978230 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:35.978451 8176 external_mini_cluster.cc:1428] Setting key 154a060972d9192d05384e3959a956a6
Aug 07 00:39:35 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:35.988061 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:35.975215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41911 (local address 127.0.0.1:58978)
0807 00:39:35.975549 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:35.975606 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:35.976251 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:35.976610 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:35.976612 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:35.976941 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:35.977132 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:35.977137 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:35.978411 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:35.978412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:35.979334 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:35.979337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:35.979952 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:35.979954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:35.980034 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:35.980778 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:35.980791 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:35.983068 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:35.986067 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:35.986080 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:35.986084 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:35.986431 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:35.986829 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:35.986830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:35.986831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:35.986934 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:35.987510 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:35.987517 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:35.987587 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 00:39:35.987672 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 00:39:35.987863 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":221,"threads_started":1}
I20260807 00:39:35.988163 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:35.975394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58978 (local address 127.7.252.62:41911)
0807 00:39:35.975590 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:35.975602 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:35.975786 (+ 184us) server_negotiation.cc:407] Connection header received
0807 00:39:35.976452 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:35.976454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:35.976485 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:35.976602 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:35.977252 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:35.978318 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:35.979440 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:35.979828 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:35.979982 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:35.983198 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:35.983210 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:35.983211 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:35.983221 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:35.985897 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:35.986536 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:35.986541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:35.986542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:35.986714 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:35.987021 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:35.987022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:35.987023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:35.987410 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:35.987518 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:35.987749 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 00:39:35.987987 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":98,"server-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
I20260807 00:39:35.989001 31518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:35.989447 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:35.989273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52618)
0807 00:39:35.989339 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:35.989414 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 00:39:35.989642 31464 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.7.252.61@KRBTEST.COM; defaulting to no policy
I20260807 00:39:35.990213 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:35.990082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52632)
0807 00:39:35.990147 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:35.990191 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 00:39:35.990419 31518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:35303: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab.
Entry for principal kudu/127.7.252.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab.
I20260807 00:39:36.015472 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:35303
--webserver_interface=127.7.252.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab
--principal=kudu/127.7.252.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41911,127.7.252.61:35303,127.7.252.60:35151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:39:36.039749 31518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } attempt: 1
I20260807 00:39:36.040472 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.040303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52638)
0807 00:39:36.040389 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.040435 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 00:39:36.040967 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.040860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52654)
0807 00:39:36.040915 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.040946 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 00:39:36.041091 31518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:35303: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
W20260807 00:39:36.104257 31525 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 00:39:36.104537 31525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:36.104569 31525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:36.104617 31525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:36.105837 31525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:36.105918 31525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:36.105942 31525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:36.105967 31525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:36.105997 31525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:36.107728 31525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41911,127.7.252.61:35303,127.7.252.60:35151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab
--principal=kudu/127.7.252.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:35303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.252.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:36.108062 31525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:36.108335 31525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:39:36.109512 31518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } attempt: 2
I20260807 00:39:36.109989 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.109848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52662)
0807 00:39:36.109918 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.109959 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 00:39:36.110431 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.110324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52678)
0807 00:39:36.110375 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.110402 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 00:39:36.110527 31518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:35303: Network error: Client connection negotiation failed: client connection to 127.7.252.61:35303: connect: Connection refused (error 111)
W20260807 00:39:36.113629 31530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:36.113642 31531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:36.113651 31533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:36.114064 31525 server_base.cc:1034] running on GCE node
I20260807 00:39:36.114367 31525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:36.114784 31525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:36.115983 31525 hybrid_clock.cc:648] HybridClock initialized: now 1786063176115965 us; error 50 us; skew 500 ppm
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:36.119026 31525 init.cc:377] Logged in from keytab as kudu/127.7.252.61@KRBTEST.COM (short username kudu)
I20260807 00:39:36.119544 31525 webserver.cc:460] Webserver started at http://127.7.252.61:46689/ using document root <none> and password file <none>
I20260807 00:39:36.119796 31525 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:36.119866 31525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:36.120021 31525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:36.121155 31525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data/instance:
uuid: "2983d701cfc9457eaaaa0374c6463401"
format_stamp: "Formatted at 2026-08-07 00:39:36 on dist-test-slave-csg5"
server_key: "03bce1f48211c814954bafed50077fc2"
server_key_iv: "c778df609c4289a8c364789bacee6278"
server_key_version: "encryptionkey@0"
I20260807 00:39:36.121546 31525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal/instance:
uuid: "2983d701cfc9457eaaaa0374c6463401"
format_stamp: "Formatted at 2026-08-07 00:39:36 on dist-test-slave-csg5"
server_key: "03bce1f48211c814954bafed50077fc2"
server_key_iv: "c778df609c4289a8c364789bacee6278"
server_key_version: "encryptionkey@0"
I20260807 00:39:36.123236 31525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 00:39:36.124171 31540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:36.124555 31525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:36.124779 31525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal
uuid: "2983d701cfc9457eaaaa0374c6463401"
format_stamp: "Formatted at 2026-08-07 00:39:36 on dist-test-slave-csg5"
server_key: "03bce1f48211c814954bafed50077fc2"
server_key_iv: "c778df609c4289a8c364789bacee6278"
server_key_version: "encryptionkey@0"
I20260807 00:39:36.124868 31525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:36.143213 31525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:36.146456 31525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:36.146708 31525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:36.151356 31525 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.61:35303
I20260807 00:39:36.151398 31595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.61:35303 every 8 connection(s)
I20260807 00:39:36.151806 31525 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
I20260807 00:39:36.152525 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31525
I20260807 00:39:36.152684 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-1/wal/instance
I20260807 00:39:36.152927 8176 external_mini_cluster.cc:1428] Setting key 2996cbdea83be23ebf6185c77a2d55e8
I20260807 00:39:36.153247 31596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:36.155869 31596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.252.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.60@KRBTEST.COM" created.
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:36.171504 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.156923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58980 (local address 127.7.252.62:41911)
0807 00:39:36.156987 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.156989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.157250 (+ 261us) server_negotiation.cc:407] Connection header received
0807 00:39:36.157847 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.157849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.157867 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.157944 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.158739 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.159714 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.161024 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.161416 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.161513 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.167717 (+ 6204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.167720 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.167720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.167730 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.169595 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.170167 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.170169 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.170170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.170246 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.170575 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.170576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.170577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.170803 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.170887 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.171214 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.171335 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 00:39:36.171532 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.156899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41911 (local address 127.0.0.1:58980)
0807 00:39:36.157102 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.157142 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.157674 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.158105 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.158114 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.158387 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.158597 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.158601 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.159861 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.159862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.160900 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.160914 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.161566 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.161568 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.161711 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.162459 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.162475 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.167554 (+ 5079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.169743 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.169757 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.169760 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.170068 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.170338 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.170340 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.170340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.170485 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.170898 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.170906 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.171055 (+ 149us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.171164 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.171344 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
I20260807 00:39:36.172355 31596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:36.184932 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.172695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52680)
0807 00:39:36.172800 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.172813 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.172861 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.173179 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.173180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.173350 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.173434 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.173437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.175031 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.175032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.175594 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.175596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.176435 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.176436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.176506 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.177076 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.177084 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.181318 (+ 4234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.183677 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.183678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.183679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.183910 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.184193 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.184194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.184194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.184257 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.184581 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.184582 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.184638 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.184701 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.184794 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 00:39:36.185030 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.172779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52680 (local address 127.7.252.61:35303)
0807 00:39:36.172977 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.172983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.173038 (+ 55us) server_negotiation.cc:407] Connection header received
0807 00:39:36.173067 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.173070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.173089 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.173176 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.173513 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.174919 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.175699 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.176301 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.176413 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.181490 (+ 5077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.181505 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.181505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.181514 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.183573 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.184052 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.184055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.184056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.184121 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.184321 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.184321 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.184322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.184496 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.184563 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.184781 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.184875 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":106,"threads_started":1}
I20260807 00:39:36.185896 31596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:36.186331 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.186197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:34994)
0807 00:39:36.186251 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.186304 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 00:39:36.186524 31543 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
I20260807 00:39:36.187126 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.187008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35010)
0807 00:39:36.187069 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.187105 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 00:39:36.187259 31596 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:35151: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab.
Entry for principal kudu/127.7.252.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab.
I20260807 00:39:36.189579 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:35151
--webserver_interface=127.7.252.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab
--principal=kudu/127.7.252.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:41911,127.7.252.61:35303,127.7.252.60:35151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:39:36.201694 31518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } attempt: 3
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:36.209470 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.202129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52682)
0807 00:39:36.202193 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.202214 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.202296 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.202511 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.202513 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.202749 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.202826 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.202829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.203514 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.203515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.204059 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.204061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.204476 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.204478 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.204570 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.205081 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.205086 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.206555 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.208326 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.208327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.208328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.208511 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.208723 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.208724 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.208725 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.208820 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.209091 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.209092 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.209143 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.209243 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.209357 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 00:39:36.209529 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.202206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52682 (local address 127.7.252.61:35303)
0807 00:39:36.202282 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.202285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.202296 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:39:36.202418 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.202419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.202431 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.202503 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.202913 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.203418 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.204149 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.204385 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.204476 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.206680 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.206682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.206682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.206691 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.208177 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.208589 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.208591 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.208591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.208653 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.208892 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.208893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.208894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.209016 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.209098 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.209271 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.209433 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 00:39:36.210201 31518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:36.210644 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.210489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35024)
0807 00:39:36.210578 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.210616 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 00:39:36.211097 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.211034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35036)
0807 00:39:36.211059 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.211081 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260807 00:39:36.211208 31518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:35151: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
I20260807 00:39:36.236578 31596 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } attempt: 1
I20260807 00:39:36.237232 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.237072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35040)
0807 00:39:36.237148 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.237199 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 00:39:36.237628 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.237517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35052)
0807 00:39:36.237574 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.237609 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 00:39:36.237741 31596 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:35151: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
I20260807 00:39:36.242380 31518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } attempt: 1
I20260807 00:39:36.242933 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.242795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35058)
0807 00:39:36.242861 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.242904 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 00:39:36.243379 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.243175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35074)
0807 00:39:36.243305 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.243347 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 00:39:36.243501 31518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:35151: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
W20260807 00:39:36.279352 31603 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 00:39:36.279623 31603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:36.279644 31603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:36.279666 31603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:36.280907 31603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:36.280958 31603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:36.280972 31603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:36.280985 31603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:36.280997 31603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:36.282581 31603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:41911,127.7.252.61:35303,127.7.252.60:35151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab
--principal=kudu/127.7.252.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:35151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.252.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:36.282873 31603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:36.283136 31603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:36.288550 31611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:36.288550 31608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:36.288591 31609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:36.288800 31603 server_base.cc:1034] running on GCE node
I20260807 00:39:36.289034 31603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:36.289317 31603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:36.290511 31603 hybrid_clock.cc:648] HybridClock initialized: now 1786063176290494 us; error 34 us; skew 500 ppm
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:36.293251 31603 init.cc:377] Logged in from keytab as kudu/127.7.252.60@KRBTEST.COM (short username kudu)
I20260807 00:39:36.293893 31603 webserver.cc:460] Webserver started at http://127.7.252.60:41419/ using document root <none> and password file <none>
I20260807 00:39:36.294093 31603 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:36.294137 31603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:36.294227 31603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:36.295385 31603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data/instance:
uuid: "d082674a567e4c50be14b6fb9cc9810d"
format_stamp: "Formatted at 2026-08-07 00:39:36 on dist-test-slave-csg5"
server_key: "7f8d22daabd6fd7f55572004d96ac85a"
server_key_iv: "bd0e59d4e8d5838bfe6a1065ddf4814f"
server_key_version: "encryptionkey@0"
I20260807 00:39:36.295785 31603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal/instance:
uuid: "d082674a567e4c50be14b6fb9cc9810d"
format_stamp: "Formatted at 2026-08-07 00:39:36 on dist-test-slave-csg5"
server_key: "7f8d22daabd6fd7f55572004d96ac85a"
server_key_iv: "bd0e59d4e8d5838bfe6a1065ddf4814f"
server_key_version: "encryptionkey@0"
I20260807 00:39:36.297130 31603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 00:39:36.297963 31618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:36.298143 31603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:36.298249 31603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal
uuid: "d082674a567e4c50be14b6fb9cc9810d"
format_stamp: "Formatted at 2026-08-07 00:39:36 on dist-test-slave-csg5"
server_key: "7f8d22daabd6fd7f55572004d96ac85a"
server_key_iv: "bd0e59d4e8d5838bfe6a1065ddf4814f"
server_key_version: "encryptionkey@0"
I20260807 00:39:36.298415 31603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:36.305915 31596 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } attempt: 2
I20260807 00:39:36.306748 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.306437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35088)
0807 00:39:36.306590 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.306640 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260807 00:39:36.307212 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.307091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35104)
0807 00:39:36.307150 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.307190 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 00:39:36.307335 31596 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:35151: Network error: Client connection negotiation failed: client connection to 127.7.252.60:35151: connect: Connection refused (error 111)
I20260807 00:39:36.307533 31603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:36.310014 31603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:36.310137 31603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:36.314504 31603 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.60:35151
I20260807 00:39:36.314659 31673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.60:35151 every 8 connection(s)
I20260807 00:39:36.314977 31603 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
I20260807 00:39:36.315970 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31603
I20260807 00:39:36.316087 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786062890064039-8176-0/minicluster-data/master-2/wal/instance
I20260807 00:39:36.316298 8176 external_mini_cluster.cc:1428] Setting key 55a708f081fcd7557f7d0a2ef340e270
I20260807 00:39:36.316430 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:36.318239 31674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:36.318672 31518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } attempt: 2
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:39:36.329260 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.318968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35130)
0807 00:39:36.319030 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.319041 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.319084 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.319762 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.319764 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.319967 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.320021 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.320023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.321336 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.321337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.322141 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.322143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.322804 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.322864 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.323702 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.323707 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.325063 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.327519 (+ 2456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.327520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.327520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.327876 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.328340 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.328341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.328341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.328408 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.328798 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.328799 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.328854 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.329017 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.329145 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 00:39:36.329491 31679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.318998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35130 (local address 127.7.252.60:35151)
0807 00:39:36.319376 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.319377 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.319383 (+ 6us) server_negotiation.cc:407] Connection header received
0807 00:39:36.319611 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.319614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.319631 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.320117 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.320257 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.321245 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322219 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.322721 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322804 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.325193 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.325202 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.325202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.325209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.327402 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.327966 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.327969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.327970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.328082 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.328485 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.328485 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.328486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.328719 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.328815 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.329098 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.329241 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":88,"threads_started":1}
I20260807 00:39:36.330298 31677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.316906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35114 (local address 127.7.252.60:35151)
0807 00:39:36.317101 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.317111 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.318989 (+ 1878us) server_negotiation.cc:407] Connection header received
0807 00:39:36.319566 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.319574 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.319596 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.319753 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.320407 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.321335 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322394 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.322745 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322811 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.326503 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.326504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.326505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.326512 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.329023 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.329409 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.329410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.329411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.329470 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.329665 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.329666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.329666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.329783 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.329902 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.330105 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.330197 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":127,"thread_start_us":69,"threads_started":1}
I20260807 00:39:36.330314 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.319163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.7.252.62:41911)
0807 00:39:36.319319 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.319321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.319331 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:36.319762 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.319764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.319773 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.319821 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.320560 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.321294 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322147 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.322444 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322513 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.325967 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.325968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.325968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.325976 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.328319 (+ 2343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.329450 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.329451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.329452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.329510 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.329743 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.329744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.329745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.329874 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.329916 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.330149 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.330224 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260807 00:39:36.330593 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.318919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:41911 (local address 127.0.0.1:58988)
0807 00:39:36.319208 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.319250 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.319611 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.319942 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.319944 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.320309 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.320461 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.320466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.321388 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.321389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.322045 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.322046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.322545 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.322546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.322702 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.323460 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.323471 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.325854 (+ 2383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.328406 (+ 2552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.328413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.328416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.328710 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.329590 (+ 880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.329591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.329591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.329666 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.329964 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.329970 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.330019 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.330379 (+ 360us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.330491 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":86,"threads_started":1}
I20260807 00:39:36.331588 31518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962: Bootstrap starting.
I20260807 00:39:36.332224 31518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:36.332523 31518 log.cc:824] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:36.333222 31674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:36.333526 31518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962: No bootstrap required, opened a new log
I20260807 00:39:36.336186 31518 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.336340 31518 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9209eb764904ad3806799f228c12962, State: Initialized, Role: FOLLOWER
I20260807 00:39:36.336431 31518 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.336766 31681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.336858 31518 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:36.336966 31681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
W20260807 00:39:36.338946 31693 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:36.338994 31693 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:36.341197 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.333495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:35303 (local address 127.0.0.1:52688)
0807 00:39:36.333706 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.333714 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.333742 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.333880 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.333880 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.334019 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.334053 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.334054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.334711 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.334712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.335211 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.335212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.335599 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.335600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.335668 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.336108 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.336113 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.337759 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.339976 (+ 2217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.339977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.339977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.340206 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.340448 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.340449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.340449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.340520 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.340855 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.340856 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.340903 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.340971 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.341076 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187}
I20260807 00:39:36.341831 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.333595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.7.252.61:35303)
0807 00:39:36.333726 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.333728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.333739 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:39:36.333818 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.333819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.333830 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.333879 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.334137 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.334608 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.335300 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.335528 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.335603 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.337857 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.337859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.337859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.337867 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.339868 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.340302 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.340303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.340303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.340365 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.340595 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.340596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.340596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.340760 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.340825 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.341612 (+ 787us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.341713 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:39:36.342723 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.333463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59002 (local address 127.7.252.62:41911)
0807 00:39:36.333501 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.333503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.333511 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:39:36.333573 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.333574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.333584 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.333638 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.334361 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.335056 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.336035 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.336317 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.336394 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.339432 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.339434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.339434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.339442 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.341195 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.341657 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.341659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.341659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.341720 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.341938 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.341938 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.341939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.342068 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.342208 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.342476 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.342564 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:39:36.340145 31445 master_runner.cc:186] Error getting master registration for 127.7.252.61:35303: OK, instance_id { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" instance_seqno: 1786063176149904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 00:39:36.342800 31445 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 00:39:36.343010 31674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:36.352175 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.343359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35146)
0807 00:39:36.343411 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.343421 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.343462 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.343623 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.343624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.343798 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.343845 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.343847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.344719 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.344720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.345382 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.345384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.345921 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.345922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.345979 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.346451 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.346464 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.348191 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.350934 (+ 2743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.350935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.350935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.351179 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.351401 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.351401 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.351402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.351466 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.351834 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.351835 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.351878 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.351924 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.352034 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 00:39:36.352501 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.343385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52698 (local address 127.7.252.61:35303)
0807 00:39:36.343420 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.343422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.343562 (+ 140us) server_negotiation.cc:407] Connection header received
0807 00:39:36.343633 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.343633 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.343643 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.343701 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.344251 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.345006 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.345828 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.346149 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.346213 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.348946 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.348947 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.348948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.348956 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.350816 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.351243 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.351244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.351245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.351306 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.351525 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.351526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.351526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.351675 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.351841 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.352287 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.352402 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 00:39:36.352610 31677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.343475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35146 (local address 127.7.252.60:35151)
0807 00:39:36.343511 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.343513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.343520 (+ 7us) server_negotiation.cc:407] Connection header received
0807 00:39:36.343539 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.343540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.343550 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.343916 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.343941 (+ 25us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.344638 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.345475 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.345793 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.345892 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.348325 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.348326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.348327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.348334 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.350818 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.351262 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.351263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.351263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.351315 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.351527 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.351528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.351528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.351743 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.352373 (+ 630us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.352415 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.352500 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:39:36.355193 31674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: Bootstrap starting.
I20260807 00:39:36.355947 31674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:36.356235 31674 log.cc:824] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:36.356566 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:36.358920 31489 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c9209eb764904ad3806799f228c12962"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002
I20260807 00:39:36.359119 31489 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 00:39:36.359189 31489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:36.359537 31674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: No bootstrap required, opened a new log
I20260807 00:39:36.359988 31489 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.360244 31489 leader_election.cc:288] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [CANDIDATE]: Term 1 election: Requested vote from peers 2983d701cfc9457eaaaa0374c6463401 (127.7.252.61:35303), d082674a567e4c50be14b6fb9cc9810d (127.7.252.60:35151)
I20260807 00:39:36.362164 31674 raft_consensus.cc:348] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.362329 31674 raft_consensus.cc:729] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d082674a567e4c50be14b6fb9cc9810d, State: Initialized, Role: FOLLOWER
I20260807 00:39:36.362435 31674 consensus_queue.cc:260] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.362779 31674 sys_catalog.cc:564] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:36.362872 31646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9209eb764904ad3806799f228c12962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d082674a567e4c50be14b6fb9cc9810d"
I20260807 00:39:36.363003 31646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:36.364332 31646 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9209eb764904ad3806799f228c12962 in term 1.
I20260807 00:39:36.364818 31463 leader_election.cc:302] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9209eb764904ad3806799f228c12962, d082674a567e4c50be14b6fb9cc9810d; no voters:
I20260807 00:39:36.364960 31681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:36.365100 31681 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [term 1 LEADER]: Becoming Leader. State: Replica: c9209eb764904ad3806799f228c12962, State: Running, Role: LEADER
I20260807 00:39:36.365222 31681 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.365651 31681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9209eb764904ad3806799f228c12962. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.365724 31681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:36.366554 31702 sys_catalog.cc:455] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.366712 31702 sys_catalog.cc:458] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:36.367522 31716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:36.367731 31716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:36.367749 31603 master_runner.cc:186] Error getting master registration for 127.7.252.61:35303: OK, instance_id { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" instance_seqno: 1786063176149904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 00:39:36.370606 31603 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 00:39:36.371410 31713 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:36.371474 31713 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:36.374732 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.361666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52710 (local address 127.7.252.61:35303)
0807 00:39:36.361708 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.361710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.361957 (+ 247us) server_negotiation.cc:407] Connection header received
0807 00:39:36.362132 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.362133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.362143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.362176 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.365643 (+ 3467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.366380 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.368152 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.368476 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.368523 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.370250 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.370252 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.370252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.370259 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.372141 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.373782 (+ 1641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.373784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.373784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.373849 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.374072 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.374073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.374073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.374215 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.374299 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.374522 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.374612 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 00:39:36.375375 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.361505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59018 (local address 127.7.252.62:41911)
0807 00:39:36.361564 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.361566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.361903 (+ 337us) server_negotiation.cc:407] Connection header received
0807 00:39:36.362012 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.362013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.362024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.362058 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.363008 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.363749 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.365456 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.365744 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.365786 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.371668 (+ 5882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.371670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.371670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.371681 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.373387 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.373936 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.373937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.373938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.374010 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.374302 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.374303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.374303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.374457 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.374547 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.375184 (+ 637us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.375269 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 00:39:36.383473 31677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.364681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35154 (local address 127.7.252.60:35151)
0807 00:39:36.364723 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.364725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.372068 (+ 7343us) server_negotiation.cc:407] Connection header received
0807 00:39:36.372531 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.372532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.372544 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.372575 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.376438 (+ 3863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.377199 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.378264 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.378567 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.378643 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.380229 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.380231 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.380231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.380240 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.381980 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.382471 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.382472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.382473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.382568 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.382811 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.382812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.382829 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.382980 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.383092 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.383269 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.383369 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:39:36.384193 31646 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [term 1 FOLLOWER]: Refusing update from remote peer c9209eb764904ad3806799f228c12962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:36.384573 31714 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:36.386152 31702 sys_catalog.cc:455] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9209eb764904ad3806799f228c12962. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.386245 31702 sys_catalog.cc:458] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:36.396067 31681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.396212 31681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:36.396294 31702 sys_catalog.cc:455] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.396413 31702 sys_catalog.cc:458] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:36.396625 31721 mvcc.cc:205] Tried to move back new op lower bound from 7315714770465189888 to 7315714770392682496. Current Snapshot: MvccSnapshot[applied={T|T < 7315714770465189888}]
I20260807 00:39:36.397599 31716 catalog_manager.cc:1347] Generated new cluster ID: ecd2021334df4ea8ac476394488c3606
I20260807 00:39:36.397661 31716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:36.398492 31596 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } attempt: 3
Aug 07 00:39:36 dist-test-slave-csg5 krb5kdc[31432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:39:36.411211 31599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.398885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:35151 (local address 127.0.0.1:35156)
0807 00:39:36.398931 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:36.398944 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:36.398991 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:36.399553 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:36.399554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:36.399753 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:36.399810 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.399812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.400918 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.400919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.401768 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:36.401771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.402844 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.402845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:36.402910 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.403466 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:36.403472 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:36.405105 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:36.409664 (+ 4559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.409665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.409665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.409907 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.410304 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:36.410305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:36.410305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:36.410371 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:36.410874 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:36.410875 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:36.410941 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 00:39:36.410990 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 00:39:36.411101 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260807 00:39:36.412168 31677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.399008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.7.252.60:35151)
0807 00:39:36.399066 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.399068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.399078 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:36.399117 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.399118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.399129 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.399905 (+ 776us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.399956 (+ 51us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.400800 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.402061 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.402702 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.404109 (+ 1407us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.405210 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:36.405212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:36.405212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:36.405219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:36.409512 (+ 4293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.410053 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.410055 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.410055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.410148 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:36.410458 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:36.410458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:36.410459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:36.410720 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:36.411747 (+ 1027us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.411828 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.412011 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 00:39:36.414189 31596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: Bootstrap starting.
I20260807 00:39:36.415022 31596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:36.415351 31596 log.cc:824] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:36.417641 31716 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:36.418589 31716 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:36.419400 31596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: No bootstrap required, opened a new log
I20260807 00:39:36.421476 31596 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.421636 31596 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2983d701cfc9457eaaaa0374c6463401, State: Initialized, Role: FOLLOWER
I20260807 00:39:36.421715 31596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } }
I20260807 00:39:36.422076 31596 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:36.422973 31568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9209eb764904ad3806799f228c12962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2983d701cfc9457eaaaa0374c6463401"
I20260807 00:39:36.423092 31568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:36.424050 31568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9209eb764904ad3806799f228c12962 in term 1.
I20260807 00:39:36.424611 31567 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [term 1 FOLLOWER]: Refusing update from remote peer c9209eb764904ad3806799f228c12962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:36.424892 31681 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:36.425984 31716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962: Generated new TSK 0
I20260807 00:39:36.426254 31716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 00:39:36.427143 31733 mvcc.cc:205] Tried to move back new op lower bound from 7315714770600390656 to 7315714770392682496. Current Snapshot: MvccSnapshot[applied={T|T < 7315714770465189888}]
I20260807 00:39:36.428602 31735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.428740 31735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:36.427466 31732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9209eb764904ad3806799f228c12962. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.429052 31732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:36.429379 31714 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.429499 31714 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9209eb764904ad3806799f228c12962 [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:36.430949 31726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9209eb764904ad3806799f228c12962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9209eb764904ad3806799f228c12962" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 41911 } } peers { permanent_uuid: "2983d701cfc9457eaaaa0374c6463401" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 35303 } } peers { permanent_uuid: "d082674a567e4c50be14b6fb9cc9810d" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 35151 } } }
I20260807 00:39:36.431026 31726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:36.431615 31744 catalog_manager.cc:1259] Loaded cluster ID: ecd2021334df4ea8ac476394488c3606
I20260807 00:39:36.431703 31744 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: loading cluster ID for follower catalog manager: success
I20260807 00:39:36.432924 31744 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: acquiring CA information for follower catalog manager: success
I20260807 00:39:36.433310 31744 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2983d701cfc9457eaaaa0374c6463401: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 00:39:36.466202 31521 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.464535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59020 (local address 127.7.252.62:41911)
0807 00:39:36.464582 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.464584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.465504 (+ 920us) server_negotiation.cc:407] Connection header received
0807 00:39:36.465611 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.465612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.465625 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.465657 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.466126 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59020: BlockingRecv error: recv got EOF from 127.0.0.1:59020 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 00:39:36.467136 31601 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.464886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.7.252.61:35303)
0807 00:39:36.464926 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.464928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.466567 (+ 1639us) server_negotiation.cc:407] Connection header received
0807 00:39:36.466695 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.466696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.466707 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.466737 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.467077 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52718: BlockingRecv error: recv got EOF from 127.0.0.1:52718 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 00:39:36.468016 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.465212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35160 (local address 127.7.252.60:35151)
0807 00:39:36.465252 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.465254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.467412 (+ 2158us) server_negotiation.cc:407] Connection header received
0807 00:39:36.467570 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.467572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.467583 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.467612 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.467958 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35160: BlockingRecv error: recv got EOF from 127.0.0.1:35160 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:39:36.473466 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.469775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52722 (local address 127.7.252.61:35303)
0807 00:39:36.469814 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.469816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.470036 (+ 220us) server_negotiation.cc:407] Connection header received
0807 00:39:36.470147 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.470148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.470197 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.470241 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.470455 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.471368 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.472481 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.472764 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.472809 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.473047 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.473178 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.473228 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.473362 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.473387 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 00:39:36.477396 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.476469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35176 (local address 127.7.252.60:35151)
0807 00:39:36.476514 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.476516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.476744 (+ 228us) server_negotiation.cc:407] Connection header received
0807 00:39:36.476863 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.476864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.476884 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.476917 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.477331 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35176: BlockingRecv error: recv got EOF from 127.0.0.1:35176 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:36.483237 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.479830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.7.252.61:35303)
0807 00:39:36.479871 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.479872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.480136 (+ 264us) server_negotiation.cc:407] Connection header received
0807 00:39:36.480235 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.480236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.480247 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.480290 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.480478 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.481259 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.482409 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.482728 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.482772 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.482976 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.483011 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.483037 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.483136 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.483160 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 00:39:36.486882 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.485944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.7.252.60:35151)
0807 00:39:36.485988 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.485990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.486219 (+ 229us) server_negotiation.cc:407] Connection header received
0807 00:39:36.486342 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.486343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.486356 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.486388 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.486823 (+ 435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35186: BlockingRecv error: recv got EOF from 127.0.0.1:35186 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:39:36.493681 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.490244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52740 (local address 127.7.252.61:35303)
0807 00:39:36.490302 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.490304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.490593 (+ 289us) server_negotiation.cc:407] Connection header received
0807 00:39:36.490738 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.490739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.490751 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.490783 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.490978 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.491714 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.492843 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.493117 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.493166 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.493398 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.493436 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.493466 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.493579 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.493603 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 00:39:36.497255 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.496395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35202 (local address 127.7.252.60:35151)
0807 00:39:36.496438 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.496440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.496655 (+ 215us) server_negotiation.cc:407] Connection header received
0807 00:39:36.496763 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.496764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.496776 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.496808 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.497197 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35202: BlockingRecv error: recv got EOF from 127.0.0.1:35202 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:36.506263 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.502710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52742 (local address 127.7.252.61:35303)
0807 00:39:36.502758 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.502761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.503072 (+ 311us) server_negotiation.cc:407] Connection header received
0807 00:39:36.503183 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.503184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.503196 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.503226 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.503551 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.504290 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.505444 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.505732 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.505780 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.505991 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.506028 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.506055 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.506160 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.506181 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260807 00:39:36.509841 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.508906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35212 (local address 127.7.252.60:35151)
0807 00:39:36.508949 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.508951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.509227 (+ 276us) server_negotiation.cc:407] Connection header received
0807 00:39:36.509353 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.509354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.509366 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.509398 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.509782 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35212: BlockingRecv error: recv got EOF from 127.0.0.1:35212 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:36.523118 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.519387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.7.252.61:35303)
0807 00:39:36.519434 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.519436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.519737 (+ 301us) server_negotiation.cc:407] Connection header received
0807 00:39:36.519851 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.519852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.519865 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.519896 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.520088 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.520820 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.522147 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.522470 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.522515 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.522811 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.522852 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.522881 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.522987 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.523031 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 00:39:36.526837 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.525742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35218 (local address 127.7.252.60:35151)
0807 00:39:36.525791 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.525793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.526085 (+ 292us) server_negotiation.cc:407] Connection header received
0807 00:39:36.526202 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.526204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.526256 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.526308 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.526773 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35218: BlockingRecv error: recv got EOF from 127.0.0.1:35218 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 00:39:36.548014 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.544471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52760 (local address 127.7.252.61:35303)
0807 00:39:36.544523 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.544526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.544851 (+ 325us) server_negotiation.cc:407] Connection header received
0807 00:39:36.544967 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.544968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.544980 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.545011 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.545235 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.545985 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.547175 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.547469 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.547516 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.547733 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.547772 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.547803 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.547910 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.547931 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260807 00:39:36.551460 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.550605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.7.252.60:35151)
0807 00:39:36.550697 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.550699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.550894 (+ 195us) server_negotiation.cc:407] Connection header received
0807 00:39:36.550988 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.550989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.551000 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.551029 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.551398 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35220: BlockingRecv error: recv got EOF from 127.0.0.1:35220 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:36.588456 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.585096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52766 (local address 127.7.252.61:35303)
0807 00:39:36.585170 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.585173 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.585311 (+ 138us) server_negotiation.cc:407] Connection header received
0807 00:39:36.585346 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.585347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.585359 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.585420 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.585592 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.586394 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.587531 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.587797 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.587903 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.588090 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.588134 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.588204 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.588273 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.588298 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 00:39:36.591496 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.590767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35226 (local address 127.7.252.60:35151)
0807 00:39:36.590825 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.590828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.590838 (+ 10us) server_negotiation.cc:407] Connection header received
0807 00:39:36.590920 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.590921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.590932 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.590977 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.591419 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35226: BlockingRecv error: recv got EOF from 127.0.0.1:35226 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:36.659972 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.656758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.7.252.61:35303)
0807 00:39:36.656907 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.656909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.657018 (+ 109us) server_negotiation.cc:407] Connection header received
0807 00:39:36.657143 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.657144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.657156 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.657348 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.657510 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.658197 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.659147 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.659397 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.659497 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.659660 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.659701 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.659780 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.659851 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.659871 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260807 00:39:36.662765 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.662013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35242 (local address 127.7.252.60:35151)
0807 00:39:36.662091 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.662093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.662174 (+ 81us) server_negotiation.cc:407] Connection header received
0807 00:39:36.662296 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.662297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.662310 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.662365 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.662713 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35242: BlockingRecv error: recv got EOF from 127.0.0.1:35242 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 00:39:36.795048 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:36.792143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52778 (local address 127.7.252.61:35303)
0807 00:39:36.792207 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.792210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.792285 (+ 75us) server_negotiation.cc:407] Connection header received
0807 00:39:36.792443 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.792444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.792455 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.792527 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:36.792660 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.793170 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.793969 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:36.794158 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:36.794219 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:36.794614 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:36.794646 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:36.794713 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:36.794905 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 00:39:36.794926 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 00:39:36.797994 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:36.797230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35244 (local address 127.7.252.60:35151)
0807 00:39:36.797351 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:36.797353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:36.797377 (+ 24us) server_negotiation.cc:407] Connection header received
0807 00:39:36.797434 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:36.797435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:36.797445 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:36.797494 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:36.797918 (+ 424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35244: BlockingRecv error: recv got EOF from 127.0.0.1:35244 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:37.058063 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:37.055453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52782 (local address 127.7.252.61:35303)
0807 00:39:37.055537 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.055542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.055557 (+ 15us) server_negotiation.cc:407] Connection header received
0807 00:39:37.055585 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.055585 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.055594 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.055653 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:37.055854 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.056418 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.057346 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.057546 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.057611 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:37.057807 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:37.057843 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:37.057905 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:37.057965 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 00:39:37.057987 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 00:39:37.061115 31677 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:37.060399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35256 (local address 127.7.252.60:35151)
0807 00:39:37.060471 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.060475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.060489 (+ 14us) server_negotiation.cc:407] Connection header received
0807 00:39:37.060514 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.060515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.060526 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.060579 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:37.061013 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35256: BlockingRecv error: recv got EOF from 127.0.0.1:35256 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 00:39:37.372007 31713 catalog_manager.cc:1259] Loaded cluster ID: ecd2021334df4ea8ac476394488c3606
I20260807 00:39:37.372099 31713 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: loading cluster ID for follower catalog manager: success
I20260807 00:39:37.372972 31713 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: acquiring CA information for follower catalog manager: success
I20260807 00:39:37.373255 31713 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d082674a567e4c50be14b6fb9cc9810d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 00:39:37.577502 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:37.574733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51110 (local address 127.7.252.61:35303)
0807 00:39:37.574884 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.574886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.574898 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:39:37.574927 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.574927 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.574938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.575002 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:37.575169 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.575733 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.576706 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.576912 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.576980 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:37.577164 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:37.577266 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:37.577315 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:37.577405 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 00:39:37.577428 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":63,"threads_started":1}
I20260807 00:39:37.582154 31874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:37.579470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.7.252.60:35151)
0807 00:39:37.579596 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.579598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.579607 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:37.579640 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.579641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.579707 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.579783 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:37.579934 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.580523 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.581310 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.581526 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.581593 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:37.581804 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:37.581918 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:37.581991 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:37.582065 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 00:39:37.582086 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260807 00:39:37.587364 31874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:37.584225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52776 (local address 127.7.252.60:35151)
0807 00:39:37.584267 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.584269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.584555 (+ 286us) server_negotiation.cc:407] Connection header received
0807 00:39:37.584581 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.584582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.584594 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.584651 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:37.584842 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.585400 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.586463 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.586769 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.586835 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:37.586979 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:37.587015 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:37.587069 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:37.587249 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 00:39:37.587278 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 00:39:37.587463 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:37.584337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.7.252.61:35303)
0807 00:39:37.584407 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.584410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.584583 (+ 173us) server_negotiation.cc:407] Connection header received
0807 00:39:37.584688 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.584689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.584701 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.584742 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:37.584935 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.585683 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.586549 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.586906 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.586962 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:37.587184 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:37.587219 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:37.587249 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:37.587363 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 00:39:37.587388 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:39:37.587734 31881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:37.584191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42246 (local address 127.7.252.62:41911)
0807 00:39:37.584310 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:37.584311 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:37.584465 (+ 154us) server_negotiation.cc:407] Connection header received
0807 00:39:37.584551 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:37.584552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:37.584601 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:37.584695 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:37.584871 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.585700 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.586710 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:37.587067 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:37.587138 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:37.587346 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:37.587460 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:37.587534 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:37.587628 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 00:39:37.587657 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260807 00:39:37.589846 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31445
I20260807 00:39:37.598392 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31525
I20260807 00:39:37.604923 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31603
2026-08-07T00:39:37Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3001 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 00:39:37 dist-test-slave-csg5 krb5kdc[31885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 00:39:37 dist-test-slave-csg5 krb5kdc[31885](info): set up 2 sockets
Aug 07 00:39:37 dist-test-slave-csg5 krb5kdc[31885](info): commencing operation
krb5kdc: starting...
W20260807 00:39:38.760795 8176 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/test-user.keytab.
Aug 07 00:39:38 dist-test-slave-csg5 krb5kdc[31885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T00:39:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T00:39:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.252.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
Entry for principal kudu/127.7.252.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab.
I20260807 00:39:38.903463 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:45237
--webserver_interface=127.7.252.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:45237,127.7.252.61:33479,127.7.252.60:42399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 00:39:38.993911 31898 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 00:39:38.994191 31898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:38.994223 31898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:38.994259 31898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:38.995559 31898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:38.995638 31898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:38.995662 31898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:38.995685 31898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:38.995725 31898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:38.997382 31898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:45237,127.7.252.61:33479,127.7.252.60:42399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.62.keytab
--principal=kudu/127.7.252.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.62:45237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.252.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:38.997694 31898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:38.997957 31898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:39.003455 31906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:39.003476 31904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:39.003615 31903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:39.004117 31898 server_base.cc:1034] running on GCE node
I20260807 00:39:39.004456 31898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:39.004797 31898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:39.006008 31898 hybrid_clock.cc:648] HybridClock initialized: now 1786063179005984 us; error 38 us; skew 500 ppm
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:39.008806 31898 init.cc:377] Logged in from keytab as kudu/127.7.252.62@KRBTEST.COM (short username kudu)
I20260807 00:39:39.009321 31898 webserver.cc:460] Webserver started at http://127.7.252.62:33099/ using document root <none> and password file <none>
I20260807 00:39:39.009542 31898 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:39.009584 31898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:39.009680 31898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:39.010856 31898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data/instance:
uuid: "6c3e6c504669441a8ec56ea8109e65dd"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "1b2cb096dc001c272dbeb1ac1b080f80"
server_key_iv: "c8bab005814084befe4ee7af198417c5"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.011179 31898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal/instance:
uuid: "6c3e6c504669441a8ec56ea8109e65dd"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "1b2cb096dc001c272dbeb1ac1b080f80"
server_key_iv: "c8bab005814084befe4ee7af198417c5"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.012610 31898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 00:39:39.013613 31914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:39.013825 31898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:39.013958 31898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal
uuid: "6c3e6c504669441a8ec56ea8109e65dd"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "1b2cb096dc001c272dbeb1ac1b080f80"
server_key_iv: "c8bab005814084befe4ee7af198417c5"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.014066 31898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:39.044656 31898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:39.047108 31898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:39.047286 31898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:39.051934 31898 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.62:45237
I20260807 00:39:39.051993 31969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.62:45237 every 8 connection(s)
I20260807 00:39:39.052434 31898 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/data/info.pb
I20260807 00:39:39.053546 31970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:39.055286 31970 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:39.060631 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31898
I20260807 00:39:39.060743 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-0/wal/instance
I20260807 00:39:39.060999 8176 external_mini_cluster.cc:1428] Setting key 31069abcf62a360d07949b86312225aa
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:39.067277 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.056125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.7.252.62:45237)
0807 00:39:39.056376 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.056386 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.056496 (+ 110us) server_negotiation.cc:407] Connection header received
0807 00:39:39.057145 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.057152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.057173 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.057299 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.058002 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.059056 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.060061 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.060421 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.060568 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.063485 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.063494 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.063494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.063501 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.065323 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.065919 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.065922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.065922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.066004 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.066298 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.066299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.066299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.066562 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.066631 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.066978 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.067088 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":68,"threads_started":1}
I20260807 00:39:39.067515 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.056014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45237 (local address 127.0.0.1:34814)
0807 00:39:39.056299 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.056376 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.056961 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.057312 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.057315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.057654 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.057873 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.057878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.059163 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.059164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.059957 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.059959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.060554 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.060555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.060627 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.061334 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.061345 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.063369 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.065472 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.065481 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.065483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.065829 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.066084 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.066085 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.066085 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.066217 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.066685 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.066693 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.066816 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.066940 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.067235 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":58,"thread_start_us":117,"threads_started":1}
I20260807 00:39:39.068405 31970 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:39.068857 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.068685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58722)
0807 00:39:39.068754 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.068820 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 00:39:39.068997 31918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
I20260807 00:39:39.069573 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.069418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58738)
0807 00:39:39.069519 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.069552 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260807 00:39:39.069747 31970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:33479: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.7.252.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab.
Entry for principal kudu/127.7.252.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab.
I20260807 00:39:39.095108 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:33479
--webserver_interface=127.7.252.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab
--principal=kudu/127.7.252.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:45237,127.7.252.61:33479,127.7.252.60:42399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:39:39.119014 31970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } attempt: 1
I20260807 00:39:39.119696 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.119542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58748)
0807 00:39:39.119612 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.119656 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 00:39:39.120158 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.120011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58762)
0807 00:39:39.120074 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.120124 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 00:39:39.120476 31970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:33479: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
W20260807 00:39:39.184166 31980 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 00:39:39.184422 31980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:39.184441 31980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:39.184464 31980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:39.185724 31980 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:39.185778 31980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:39.185793 31980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:39.185806 31980 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:39.185819 31980 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:39.187438 31980 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:45237,127.7.252.61:33479,127.7.252.60:42399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.61.keytab
--principal=kudu/127.7.252.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.61:33479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.252.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:39.187704 31980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:39.187971 31980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 00:39:39.188676 31970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } attempt: 2
I20260807 00:39:39.189195 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.189024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58768)
0807 00:39:39.189098 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.189137 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 00:39:39.189752 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.189653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58784)
0807 00:39:39.189701 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.189731 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 00:39:39.189914 31970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.61:33479: Network error: Client connection negotiation failed: client connection to 127.7.252.61:33479: connect: Connection refused (error 111)
W20260807 00:39:39.193349 31987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:39.193356 31989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:39.193421 31986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:39.193578 31980 server_base.cc:1034] running on GCE node
I20260807 00:39:39.193871 31980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:39.194217 31980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:39.195432 31980 hybrid_clock.cc:648] HybridClock initialized: now 1786063179195403 us; error 53 us; skew 500 ppm
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:39.198411 31980 init.cc:377] Logged in from keytab as kudu/127.7.252.61@KRBTEST.COM (short username kudu)
I20260807 00:39:39.199026 31980 webserver.cc:460] Webserver started at http://127.7.252.61:42191/ using document root <none> and password file <none>
I20260807 00:39:39.199254 31980 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:39.199302 31980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:39.199416 31980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:39.200702 31980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data/instance:
uuid: "86589ffc2ba947568f10df84526ecaf5"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "83ab507aa38f6cbbd1080fcdb212351b"
server_key_iv: "55be1383e72859cbb0af956e97bf65e1"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.201061 31980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal/instance:
uuid: "86589ffc2ba947568f10df84526ecaf5"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "83ab507aa38f6cbbd1080fcdb212351b"
server_key_iv: "55be1383e72859cbb0af956e97bf65e1"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.202716 31980 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 00:39:39.203688 31997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:39.204028 31980 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 00:39:39.204121 31980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal
uuid: "86589ffc2ba947568f10df84526ecaf5"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "83ab507aa38f6cbbd1080fcdb212351b"
server_key_iv: "55be1383e72859cbb0af956e97bf65e1"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.204332 31980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:39.220427 31980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:39.223277 31980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:39.223459 31980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:39.228695 31980 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.61:33479
I20260807 00:39:39.228778 32050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.61:33479 every 8 connection(s)
I20260807 00:39:39.229202 31980 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/data/info.pb
I20260807 00:39:39.230449 32051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:39.231848 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 31980
I20260807 00:39:39.231956 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-1/wal/instance
I20260807 00:39:39.232184 8176 external_mini_cluster.cc:1428] Setting key a9817a5089a54691fb2225e798381f31
I20260807 00:39:39.232362 32051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.252.60@KRBTEST.COM; defaulting to no policy
I20260807 00:39:39.244040 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.233185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34818 (local address 127.7.252.62:45237)
0807 00:39:39.233296 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.233299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.233453 (+ 154us) server_negotiation.cc:407] Connection header received
0807 00:39:39.233926 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.233928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.233942 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.234042 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.235047 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.235665 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.237278 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.237498 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.237578 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.240486 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.240489 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.240489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.240498 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.242268 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.242845 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.242846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.242847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.242909 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.243347 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.243348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.243348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.243482 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.243543 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.243880 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.243961 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 00:39:39.244231 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.233124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45237 (local address 127.0.0.1:34818)
0807 00:39:39.233301 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.233348 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.233826 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.234148 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.234153 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.234563 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.234904 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.234911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.235781 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.235783 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.237155 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.237160 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.237632 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.237634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.237796 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.238476 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.238486 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.240365 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.242383 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.242391 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.242394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.242745 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.243051 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.243052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.243052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.243218 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.243555 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.243562 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.243703 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.243823 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.243981 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260807 00:39:39.244930 32051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.252.60@KRBTEST.COM" created.
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:39.254489 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.245277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58790)
0807 00:39:39.245397 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.245409 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.245457 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.245884 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.245886 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.246072 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.246154 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.246156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.247182 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.247183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.247907 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.247909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.248642 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.248644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.248705 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.249185 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.249190 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.250810 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.253117 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.253118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.253118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.253394 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.253660 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.253662 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.253662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.253725 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.254126 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.254127 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.254245 (+ 118us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.254310 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.254401 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260807 00:39:39.254619 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.245344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58790 (local address 127.7.252.61:33479)
0807 00:39:39.245726 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.245730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.245747 (+ 17us) server_negotiation.cc:407] Connection header received
0807 00:39:39.245767 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.245769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.245780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.245848 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.246273 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.247086 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.248007 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.248528 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.248615 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.250906 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.250919 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.250919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.250928 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.253011 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.253493 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.253497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.253498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.253563 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.253809 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.253810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.253811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.254044 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.254142 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.254379 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.254473 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":92,"threads_started":1}
I20260807 00:39:39.255333 32051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:39.255716 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.255593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55430)
0807 00:39:39.255644 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.255694 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 00:39:39.256019 31999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
I20260807 00:39:39.256573 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.256450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55438)
0807 00:39:39.256500 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.256529 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 00:39:39.256784 32051 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:42399: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.252.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab.
Entry for principal kudu/127.7.252.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab.
I20260807 00:39:39.266616 8176 external_mini_cluster.cc:1326] Running /tmp/dist-test-task2dG0Jg/build/release/bin/kudu
/tmp/dist-test-task2dG0Jg/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:42399
--webserver_interface=127.7.252.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab
--principal=kudu/127.7.252.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.252.20:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.252.62:45237,127.7.252.61:33479,127.7.252.60:42399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 00:39:39.281085 31970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } attempt: 3
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:39.289640 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.281628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.7.252.61:33479)
0807 00:39:39.281706 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.281708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.281749 (+ 41us) server_negotiation.cc:407] Connection header received
0807 00:39:39.281775 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.281776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.281785 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.281833 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.282276 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.282875 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.284227 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.284458 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.284521 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.286921 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.286923 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.286923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.286931 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.288420 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.288815 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.288816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.288817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.288878 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.289093 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.289094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.289094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.289215 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.289291 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.289452 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.289537 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 00:39:39.289647 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.281556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58798)
0807 00:39:39.281626 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.281639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.281686 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.281872 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.281874 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.282088 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.282171 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.282173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.282997 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.282999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.284104 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.284109 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.284548 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.284549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.284647 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.285176 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.285183 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.286795 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.288537 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.288538 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.288539 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.288726 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.288956 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.288957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.288957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.289021 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.289283 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.289284 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.289335 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.289427 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.289535 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 00:39:39.290345 31970 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:39.290849 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.290610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55446)
0807 00:39:39.290775 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.290817 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260807 00:39:39.291288 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.291187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55452)
0807 00:39:39.291237 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.291264 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 00:39:39.291388 31970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:42399: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
I20260807 00:39:39.306111 32051 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } attempt: 1
I20260807 00:39:39.306896 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.306741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55454)
0807 00:39:39.306810 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.306859 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 00:39:39.307307 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.307198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55464)
0807 00:39:39.307249 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.307279 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 00:39:39.307528 32051 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:42399: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
I20260807 00:39:39.322547 31970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } attempt: 1
I20260807 00:39:39.323123 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.322981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55466)
0807 00:39:39.323049 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.323091 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 00:39:39.323613 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.323484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55474)
0807 00:39:39.323555 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.323588 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 00:39:39.323753 31970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:42399: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
W20260807 00:39:39.358529 32059 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 00:39:39.358896 32059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 00:39:39.358943 32059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 00:39:39.358985 32059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 00:39:39.360380 32059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 00:39:39.360476 32059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 00:39:39.360502 32059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 00:39:39.360533 32059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 00:39:39.360565 32059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 00:39:39.362251 32059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.252.20:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.252.62:45237,127.7.252.61:33479,127.7.252.60:42399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/krb5kdc/kudu_127.7.252.60.keytab
--principal=kudu/127.7.252.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.252.60:42399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.252.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 23:47:59 UTC on ccycloud.quasar-wqpycd.root.comops.site
build id 4571632
I20260807 00:39:39.362548 32059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 00:39:39.362828 32059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 00:39:39.368136 32065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:39.368136 32068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 00:39:39.368237 32066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 00:39:39.368335 32059 server_base.cc:1034] running on GCE node
I20260807 00:39:39.368930 32059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 00:39:39.369284 32059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 00:39:39.370465 32059 hybrid_clock.cc:648] HybridClock initialized: now 1786063179370437 us; error 45 us; skew 500 ppm
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 00:39:39.373652 32059 init.cc:377] Logged in from keytab as kudu/127.7.252.60@KRBTEST.COM (short username kudu)
I20260807 00:39:39.374274 32059 webserver.cc:460] Webserver started at http://127.7.252.60:45733/ using document root <none> and password file <none>
I20260807 00:39:39.374555 32059 fs_manager.cc:359] Metadata directory not provided
I20260807 00:39:39.374634 32059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 00:39:39.374856 32059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 00:39:39.375705 32051 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } attempt: 2
I20260807 00:39:39.376230 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.376067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55484)
0807 00:39:39.376137 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.376184 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 00:39:39.376716 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.376604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55486)
0807 00:39:39.376658 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.376692 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 00:39:39.376605 32059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data/instance:
uuid: "e1e44b49516c4814a6ce7c2bb48af8be"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "56ea49760852630de1a7c6aef5672054"
server_key_iv: "e8191ba9c0c7409273fd9a44e998b7cd"
server_key_version: "encryptionkey@0"
W20260807 00:39:39.376932 32051 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:42399: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
I20260807 00:39:39.377095 32059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal/instance:
uuid: "e1e44b49516c4814a6ce7c2bb48af8be"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "56ea49760852630de1a7c6aef5672054"
server_key_iv: "e8191ba9c0c7409273fd9a44e998b7cd"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.378639 32059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260807 00:39:39.379603 32075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 00:39:39.379866 32059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 00:39:39.379967 32059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data,/tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal
uuid: "e1e44b49516c4814a6ce7c2bb48af8be"
format_stamp: "Formatted at 2026-08-07 00:39:39 on dist-test-slave-csg5"
server_key: "56ea49760852630de1a7c6aef5672054"
server_key_iv: "e8191ba9c0c7409273fd9a44e998b7cd"
server_key_version: "encryptionkey@0"
I20260807 00:39:39.380062 32059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 00:39:39.398959 31970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } attempt: 2
I20260807 00:39:39.399569 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.399400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55494)
0807 00:39:39.399475 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.399527 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 00:39:39.400098 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.399960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55506)
0807 00:39:39.400034 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.400070 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 00:39:39.400249 31970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.252.60:42399: Network error: Client connection negotiation failed: client connection to 127.7.252.60:42399: connect: Connection refused (error 111)
I20260807 00:39:39.407652 32059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 00:39:39.410228 32059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 00:39:39.410449 32059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 00:39:39.414839 32059 rpc_server.cc:307] RPC server started. Bound to: 127.7.252.60:42399
I20260807 00:39:39.414872 32132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.252.60:42399 every 8 connection(s)
I20260807 00:39:39.415257 32059 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/data/info.pb
I20260807 00:39:39.416481 32133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 00:39:39.418411 32133 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } has no permanent_uuid. Determining permanent_uuid...
I20260807 00:39:39.423326 8176 external_mini_cluster.cc:1388] Started /tmp/dist-test-task2dG0Jg/build/release/bin/kudu as pid 32059
I20260807 00:39:39.423465 8176 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task2dG0Jg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786062890064039-8176-0/minicluster-data/master-2/wal/instance
I20260807 00:39:39.424060 8176 external_mini_cluster.cc:1428] Setting key 7cc0635c22784927cb8dec84df4d0a7e
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
I20260807 00:39:39.429335 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.419245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.62:45237 (local address 127.0.0.1:34828)
0807 00:39:39.419580 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.419618 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.420097 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.420380 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.420383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.420651 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.420865 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.420869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.421580 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.421581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.422541 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.422544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.423054 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.423055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.423217 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.423934 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.423946 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.425537 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.427442 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.427449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.427452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.427834 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.428055 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.428056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.428056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.428202 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.428699 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.428708 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.428900 (+ 192us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.429020 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.429153 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":147,"threads_started":1}
I20260807 00:39:39.429525 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.419336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34828 (local address 127.7.252.62:45237)
0807 00:39:39.419421 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.419424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.419735 (+ 311us) server_negotiation.cc:407] Connection header received
0807 00:39:39.420228 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.420230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.420242 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.420308 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.420971 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.421470 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.422641 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.422949 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.423017 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.425634 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.425636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.425637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.425646 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.427328 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.427908 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.427910 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.427910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.427973 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.428367 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.428369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.428369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.428564 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.428662 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.429082 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.429374 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:39:39.430492 32133 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:39.436031 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.424525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.7.252.60:42399)
0807 00:39:39.424769 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.424774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.424801 (+ 27us) server_negotiation.cc:407] Connection header received
0807 00:39:39.424826 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.424828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.424857 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.424944 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.425657 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.426587 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.427703 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.428231 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.428326 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.431968 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.431977 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.431978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.431985 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.434093 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.434571 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.434575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.434575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.434699 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.434973 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.434974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.434974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.435184 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.435346 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.435593 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.435708 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":100,"threads_started":1}
I20260807 00:39:39.439612 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.430874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.61:33479 (local address 127.0.0.1:58812)
0807 00:39:39.430940 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.430954 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.431005 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.431410 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.431412 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.431623 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.431683 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.431685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.432620 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.432621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.433598 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.433601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.434024 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.434025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.434121 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.434576 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.434582 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.436452 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.438504 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.438505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.438506 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.438767 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.438969 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.438970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.438970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.439039 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.439274 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.439275 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.439321 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.439392 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.439489 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 00:39:39.439687 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.430974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58812 (local address 127.7.252.61:33479)
0807 00:39:39.431089 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.431091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.431103 (+ 12us) server_negotiation.cc:407] Connection header received
0807 00:39:39.431133 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.431134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.431146 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.431220 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.431791 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.432520 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.433709 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.433932 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.433995 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.436579 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.436581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.436581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.436591 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.438408 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.438836 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.438837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.438838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.438898 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.439112 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.439113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.439113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.439215 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.439264 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.439467 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.439578 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 00:39:39.440485 32133 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.62@KRBTEST.COM
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.60@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:39:39.445453 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.436911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.7.252.62:45237)
0807 00:39:39.436957 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.436959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.436967 (+ 8us) server_negotiation.cc:407] Connection header received
0807 00:39:39.436994 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.436995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.437006 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.437073 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.437673 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.438542 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.439585 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.439900 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.439991 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.442520 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.442522 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.442522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.442530 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.444253 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.444641 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.444642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.444642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.444701 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.444912 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.444913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.444913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.445035 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.445234 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.445271 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.445347 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 00:39:39.447739 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.440819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55520)
0807 00:39:39.440874 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.440886 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.440924 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.441084 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.441085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.441200 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.441236 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.441237 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.442024 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.442025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.442556 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.442557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.443094 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.443096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.443160 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.443513 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.443518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.444810 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.446826 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.446827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.446827 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.447033 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.447238 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.447239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.447239 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.447286 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.447516 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.447516 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.447549 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.447594 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.447672 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 00:39:39.447860 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.440900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55520 (local address 127.7.252.60:42399)
0807 00:39:39.440944 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.440945 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.440954 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:39.440979 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.440980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.440993 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.441060 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.441308 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.441924 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.442676 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.442996 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.443066 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.444920 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.444922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.444922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.444929 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.446734 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.447106 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.447108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.447108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.447171 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.447326 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.447327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.447327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.447456 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.447528 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.447617 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.447738 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":23}
I20260807 00:39:39.449684 32133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: Bootstrap starting.
I20260807 00:39:39.450914 32133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:39.451260 32133 log.cc:824] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: Log is configured to *not* fsync() on all Append() calls
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.252.61@KRBTEST.COM
I20260807 00:39:39.452234 32133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: No bootstrap required, opened a new log
I20260807 00:39:39.454630 32133 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.454900 32133 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e44b49516c4814a6ce7c2bb48af8be, State: Initialized, Role: FOLLOWER
I20260807 00:39:39.454996 32133 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.455338 32139 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.455389 32133 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:39.455458 32139 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:39.456108 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.446181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58818 (local address 127.7.252.61:33479)
0807 00:39:39.446218 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.446220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.446229 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:39.446303 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.446304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.446315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.446370 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.447031 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.448259 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.449169 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.449411 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.449470 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.452582 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.452584 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.452585 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.452594 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.454404 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.454867 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.454869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.454869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.454940 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.455298 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.455299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.455299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.455471 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.455647 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.455897 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.456027 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 00:39:39.457525 32151 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:39.457589 32151 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:39.458170 8176 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 00:39:39.459663 31944 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6c3e6c504669441a8ec56ea8109e65dd"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34840
I20260807 00:39:39.457818 32059 master_runner.cc:186] Error getting master registration for 127.7.252.62:45237: OK, instance_id { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" instance_seqno: 1786063179050453 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 00:39:39.461187 32059 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 00:39:39.468082 32051 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } attempt: 3
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.61@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:39:39.478077 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.468616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55526 (local address 127.7.252.60:42399)
0807 00:39:39.468698 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.468701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.468714 (+ 13us) server_negotiation.cc:407] Connection header received
0807 00:39:39.468744 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.468746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.468758 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.468831 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.469217 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.470065 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.471773 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.472128 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.472217 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.474841 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.474844 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.474844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.474853 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.476606 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.477089 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.477090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.477090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.477152 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.477379 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.477380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.477380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.477599 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.477669 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.477864 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.477954 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 00:39:39.478089 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.468512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55526)
0807 00:39:39.468585 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.468602 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.468676 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.468848 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.468850 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.469064 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.469125 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.469127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.470178 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.470179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.471654 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.471658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.472226 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.472227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.472287 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.472914 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.472920 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.474722 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.476718 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.476719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.476719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.476998 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.477226 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.477227 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.477227 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.477310 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.477685 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.477686 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.477744 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.477830 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.477971 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 00:39:39.480087 32051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: Bootstrap starting.
I20260807 00:39:39.480993 32051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:39.481360 32051 log.cc:824] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:39.482405 32051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: No bootstrap required, opened a new log
I20260807 00:39:39.484953 32051 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.485138 32051 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86589ffc2ba947568f10df84526ecaf5, State: Initialized, Role: FOLLOWER
I20260807 00:39:39.485265 32051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.485641 32154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.485728 32051 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:39.485759 32154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:39:39.487900 32166 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:39.487967 32166 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:39.488314 31980 master_runner.cc:186] Error getting master registration for 127.7.252.62:45237: OK, instance_id { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" instance_seqno: 1786063179050453 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 00:39:39.490875 31980 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 00:39:39.499465 31970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } attempt: 3
Aug 07 00:39:39 dist-test-slave-csg5 krb5kdc[31885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786063179, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.252.62@KRBTEST.COM for kudu/127.7.252.60@KRBTEST.COM
I20260807 00:39:39.509176 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.499873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.252.60:42399 (local address 127.0.0.1:55534)
0807 00:39:39.500019 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 00:39:39.500032 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 00:39:39.500081 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 00:39:39.500384 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 00:39:39.500385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 00:39:39.500601 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 00:39:39.500663 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.500665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.501809 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.501810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.502641 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 00:39:39.502645 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.503218 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.503220 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 00:39:39.503282 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.503833 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 00:39:39.503854 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 00:39:39.505652 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 00:39:39.507740 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.507741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.507741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.508010 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.508298 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 00:39:39.508299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 00:39:39.508299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 00:39:39.508396 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 00:39:39.508736 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 00:39:39.508737 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 00:39:39.508852 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 00:39:39.508936 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 00:39:39.509057 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260807 00:39:39.509184 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.500168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55534 (local address 127.7.252.60:42399)
0807 00:39:39.500216 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.500218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.500227 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:39.500256 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.500257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.500267 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.500326 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.500760 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.501684 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.502783 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.503087 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.503151 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.505756 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.505759 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.505759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.505768 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.507606 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.508144 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.508145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.508145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.508213 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.508482 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.508484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.508484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.508649 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.508729 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.508982 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.509073 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 00:39:39.511507 31970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: Bootstrap starting.
I20260807 00:39:39.512308 31970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: Neither blocks nor log segments found. Creating new log.
I20260807 00:39:39.512626 31970 log.cc:824] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: Log is configured to *not* fsync() on all Append() calls
I20260807 00:39:39.513610 31970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: No bootstrap required, opened a new log
I20260807 00:39:39.515190 31970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.515450 31970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3e6c504669441a8ec56ea8109e65dd, State: Initialized, Role: FOLLOWER
I20260807 00:39:39.515599 31970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.516049 31944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 00:39:39.516000 32169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.516182 31944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:39.516021 31970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 00:39:39.517164 31944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.517464 31944 leader_election.cc:288] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [CANDIDATE]: Term 1 election: Requested vote from peers 86589ffc2ba947568f10df84526ecaf5 (127.7.252.61:33479), e1e44b49516c4814a6ce7c2bb48af8be (127.7.252.60:42399)
I20260807 00:39:39.517930 32025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c3e6c504669441a8ec56ea8109e65dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "86589ffc2ba947568f10df84526ecaf5"
I20260807 00:39:39.518117 32025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [term 0 FOLLOWER]: Advancing to term 1
W20260807 00:39:39.518749 32181 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 00:39:39.518868 32181 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 00:39:39.519186 32025 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c3e6c504669441a8ec56ea8109e65dd in term 1.
I20260807 00:39:39.519665 31918 leader_election.cc:302] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c3e6c504669441a8ec56ea8109e65dd, 86589ffc2ba947568f10df84526ecaf5; no voters:
I20260807 00:39:39.520262 32105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c3e6c504669441a8ec56ea8109e65dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e1e44b49516c4814a6ce7c2bb48af8be"
I20260807 00:39:39.520438 32105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [term 0 FOLLOWER]: Advancing to term 1
I20260807 00:39:39.521451 32105 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c3e6c504669441a8ec56ea8109e65dd in term 1.
I20260807 00:39:39.524557 31898 master_runner.cc:263] No leader master found from master 6c3e6c504669441a8ec56ea8109e65dd
I20260807 00:39:39.524627 31898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 00:39:39.516183 32169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:39.524744 32169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 00:39:39.524806 32169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [term 1 LEADER]: Becoming Leader. State: Replica: 6c3e6c504669441a8ec56ea8109e65dd, State: Running, Role: LEADER
I20260807 00:39:39.524896 32169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } }
I20260807 00:39:39.525429 32169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c3e6c504669441a8ec56ea8109e65dd. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.525521 32169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:39.530804 32189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 00:39:39.531133 32189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 00:39:39.539657 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.526114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.7.252.61:33479)
0807 00:39:39.526156 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.526158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.530917 (+ 4759us) server_negotiation.cc:407] Connection header received
0807 00:39:39.531061 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.531063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.531078 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.531123 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.532075 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.532927 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.534130 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.534475 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.534521 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.536326 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.536328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.536329 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.536337 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.538174 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.538639 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.538641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.538641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.538735 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.538967 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.538968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.538968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.539110 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.539188 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.539446 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.539539 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 00:39:39.542210 32105 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [term 1 FOLLOWER]: Refusing update from remote peer 6c3e6c504669441a8ec56ea8109e65dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:39.542554 32025 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [term 1 FOLLOWER]: Refusing update from remote peer 6c3e6c504669441a8ec56ea8109e65dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 00:39:39.543620 32169 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:39.543815 32169 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 00:39:39.545396 32154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c3e6c504669441a8ec56ea8109e65dd. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.545491 32154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:39.545559 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.525882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.7.252.60:42399)
0807 00:39:39.525929 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.525931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.532126 (+ 6195us) server_negotiation.cc:407] Connection header received
0807 00:39:39.532239 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.532240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.532253 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.532285 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.533276 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.534206 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.540065 (+ 5859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.540414 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.540464 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.542485 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.542487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.542488 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.542497 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.544168 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.544680 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.544681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.544682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.544737 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.544937 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.544938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.544939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.545070 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.545161 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.545372 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.545461 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 00:39:39.546587 32139 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c3e6c504669441a8ec56ea8109e65dd. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.546727 32139 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: This master's current role is: FOLLOWER
W20260807 00:39:39.548169 31921 tablet.cc:2369] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 00:39:39.548985 32183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.549126 32183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:39.550218 32139 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.550343 32139 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:39.550494 32169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.550582 32169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd [sys.catalog]: This master's current role is: LEADER
I20260807 00:39:39.551055 32154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c3e6c504669441a8ec56ea8109e65dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c3e6c504669441a8ec56ea8109e65dd" member_type: VOTER last_known_addr { host: "127.7.252.62" port: 45237 } } peers { permanent_uuid: "86589ffc2ba947568f10df84526ecaf5" member_type: VOTER last_known_addr { host: "127.7.252.61" port: 33479 } } peers { permanent_uuid: "e1e44b49516c4814a6ce7c2bb48af8be" member_type: VOTER last_known_addr { host: "127.7.252.60" port: 42399 } } }
I20260807 00:39:39.551158 32154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 00:39:39.551450 32193 mvcc.cc:205] Tried to move back new op lower bound from 7315714783400669184 to 7315714783334936576. Current Snapshot: MvccSnapshot[applied={T|T < 7315714783400669184}]
I20260807 00:39:39.551654 32198 mvcc.cc:205] Tried to move back new op lower bound from 7315714783400669184 to 7315714783334936576. Current Snapshot: MvccSnapshot[applied={T|T < 7315714783400669184}]
I20260807 00:39:39.552523 32189 catalog_manager.cc:1347] Generated new cluster ID: e51d5ea0b42046fb960b78c0799bd96b
I20260807 00:39:39.552582 32189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 00:39:39.556082 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:39.526707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.7.252.62:45237)
0807 00:39:39.526759 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.526761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.533177 (+ 6416us) server_negotiation.cc:407] Connection header received
0807 00:39:39.533245 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.533246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.533260 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.533324 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.545119 (+ 11795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.545909 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.547110 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:39.547416 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:39.547466 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:39.549324 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 00:39:39.549326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 00:39:39.549326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 00:39:39.549335 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 00:39:39.554541 (+ 5206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.555009 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.555011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.555011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.555069 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 00:39:39.555254 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 00:39:39.555255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 00:39:39.555255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 00:39:39.555387 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 00:39:39.555491 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:39.555904 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 00:39:39.555983 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 00:39:39.600263 32189 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 00:39:39.601150 32189 catalog_manager.cc:1504] Loading token signing keys...
I20260807 00:39:39.615984 32189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c3e6c504669441a8ec56ea8109e65dd: Generated new TSK 0
I20260807 00:39:39.616317 32189 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 00:39:39.650126 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.648250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.7.252.61:33479)
0807 00:39:39.648298 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.648300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.649380 (+ 1080us) server_negotiation.cc:407] Connection header received
0807 00:39:39.649500 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.649501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.649513 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.649547 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.650048 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58834: BlockingRecv error: recv got EOF from 127.0.0.1:58834 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260807 00:39:39.650997 32137 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.648709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.7.252.60:42399)
0807 00:39:39.648755 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.648757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.650416 (+ 1659us) server_negotiation.cc:407] Connection header received
0807 00:39:39.650516 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.650517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.650528 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.650559 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.650932 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55538: BlockingRecv error: recv got EOF from 127.0.0.1:55538 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260807 00:39:39.651788 31973 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.649076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34864 (local address 127.7.252.62:45237)
0807 00:39:39.649122 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.649124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.651257 (+ 2133us) server_negotiation.cc:407] Connection header received
0807 00:39:39.651356 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.651357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.651369 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.651400 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.651718 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34864: BlockingRecv error: recv got EOF from 127.0.0.1:34864 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 00:39:39.654448 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.653578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58838 (local address 127.7.252.61:33479)
0807 00:39:39.653617 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.653619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.653867 (+ 248us) server_negotiation.cc:407] Connection header received
0807 00:39:39.653982 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.653983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.654003 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.654033 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.654396 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58838: BlockingRecv error: recv got EOF from 127.0.0.1:58838 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 00:39:39.657639 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.656823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58842 (local address 127.7.252.61:33479)
0807 00:39:39.656860 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.656862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.657110 (+ 248us) server_negotiation.cc:407] Connection header received
0807 00:39:39.657212 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.657213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.657223 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.657252 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.657587 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58842: BlockingRecv error: recv got EOF from 127.0.0.1:58842 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 00:39:39.661639 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.660888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58850 (local address 127.7.252.61:33479)
0807 00:39:39.660947 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.660950 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.661089 (+ 139us) server_negotiation.cc:407] Connection header received
0807 00:39:39.661185 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.661186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.661210 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.661240 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.661584 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58850: BlockingRecv error: recv got EOF from 127.0.0.1:58850 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260807 00:39:39.668131 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.667214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58866 (local address 127.7.252.61:33479)
0807 00:39:39.667272 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.667274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.667551 (+ 277us) server_negotiation.cc:407] Connection header received
0807 00:39:39.667652 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.667653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.667666 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.667695 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.668069 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58866: BlockingRecv error: recv got EOF from 127.0.0.1:58866 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 00:39:39.678491 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.677652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.7.252.61:33479)
0807 00:39:39.677703 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.677706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.677871 (+ 165us) server_negotiation.cc:407] Connection header received
0807 00:39:39.677944 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.677945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.677957 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.678035 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.678411 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58868: BlockingRecv error: recv got EOF from 127.0.0.1:58868 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 00:39:39.696784 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.695823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58882 (local address 127.7.252.61:33479)
0807 00:39:39.695880 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.695883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.696164 (+ 281us) server_negotiation.cc:407] Connection header received
0807 00:39:39.696286 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.696287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.696299 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.696346 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.696713 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58882: BlockingRecv error: recv got EOF from 127.0.0.1:58882 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260807 00:39:39.730885 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.730074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58892 (local address 127.7.252.61:33479)
0807 00:39:39.730148 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.730150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.730165 (+ 15us) server_negotiation.cc:407] Connection header received
0807 00:39:39.730287 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.730288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.730300 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.730373 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.730820 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58892: BlockingRecv error: recv got EOF from 127.0.0.1:58892 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 00:39:39.797101 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.796340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58902 (local address 127.7.252.61:33479)
0807 00:39:39.796403 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.796405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.796441 (+ 36us) server_negotiation.cc:407] Connection header received
0807 00:39:39.796469 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.796470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.796480 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.796556 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.797023 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58902: BlockingRecv error: recv got EOF from 127.0.0.1:58902 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260807 00:39:39.927552 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:39.926428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58918 (local address 127.7.252.61:33479)
0807 00:39:39.926671 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:39.926673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:39.926764 (+ 91us) server_negotiation.cc:407] Connection header received
0807 00:39:39.926892 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:39.926893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:39.926914 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:39.926985 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:39.927452 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58918: BlockingRecv error: recv got EOF from 127.0.0.1:58918 (error 108)
Metrics: {"server-negotiator.queue_time_us":177}
W20260807 00:39:40.185869 32056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 00:39:40.184804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.7.252.61:33479)
0807 00:39:40.184870 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:40.184872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:40.185014 (+ 142us) server_negotiation.cc:407] Connection header received
0807 00:39:40.185193 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:40.185195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:40.185208 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:40.185276 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 00:39:40.185704 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58922: BlockingRecv error: recv got EOF from 127.0.0.1:58922 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 00:39:40.458134 32151 catalog_manager.cc:1259] Loaded cluster ID: e51d5ea0b42046fb960b78c0799bd96b
I20260807 00:39:40.458295 32151 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: loading cluster ID for follower catalog manager: success
I20260807 00:39:40.459283 32151 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: acquiring CA information for follower catalog manager: success
I20260807 00:39:40.459569 32151 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1e44b49516c4814a6ce7c2bb48af8be: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 00:39:40.488476 32166 catalog_manager.cc:1259] Loaded cluster ID: e51d5ea0b42046fb960b78c0799bd96b
I20260807 00:39:40.488559 32166 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: loading cluster ID for follower catalog manager: success
I20260807 00:39:40.489471 32166 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: acquiring CA information for follower catalog manager: success
I20260807 00:39:40.489853 32166 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86589ffc2ba947568f10df84526ecaf5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 00:39:40.702768 32271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:40.699192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58934 (local address 127.7.252.61:33479)
0807 00:39:40.699339 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:40.699342 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:40.699373 (+ 31us) server_negotiation.cc:407] Connection header received
0807 00:39:40.699458 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:40.699459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:40.699515 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:40.699595 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:40.700088 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.700861 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.701737 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.701976 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.702041 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:40.702212 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:40.702349 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:40.702427 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:40.702488 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 00:39:40.702512 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260807 00:39:40.707791 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:40.705045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55546 (local address 127.7.252.60:42399)
0807 00:39:40.705172 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:40.705175 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:40.705194 (+ 19us) server_negotiation.cc:407] Connection header received
0807 00:39:40.705241 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:40.705242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:40.705289 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:40.705450 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:40.705550 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.706065 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.706904 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.707133 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.707213 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:40.707372 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:40.707537 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:40.707624 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:40.707666 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 00:39:40.707690 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":52,"threads_started":1}
I20260807 00:39:40.713604 32288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:40.710153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34880 (local address 127.7.252.62:45237)
0807 00:39:40.710371 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:40.710374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:40.710385 (+ 11us) server_negotiation.cc:407] Connection header received
0807 00:39:40.710436 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:40.710436 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:40.710479 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:40.710571 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:40.710781 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.711538 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.712514 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.712801 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.712871 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:40.713112 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:40.713289 (+ 177us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:40.713351 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:40.713461 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 00:39:40.713500 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":70,"threads_started":1}
I20260807 00:39:40.713604 32271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:40.710094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58946 (local address 127.7.252.61:33479)
0807 00:39:40.710270 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:40.710272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:40.710281 (+ 9us) server_negotiation.cc:407] Connection header received
0807 00:39:40.710331 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:40.710333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:40.710347 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:40.710416 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:40.710565 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.711378 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.712715 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.712986 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.713083 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:40.713232 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:40.713274 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:40.713336 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:40.713506 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 00:39:40.713535 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260807 00:39:40.714807 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 00:39:40.710277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55552 (local address 127.7.252.60:42399)
0807 00:39:40.710351 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 00:39:40.710353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 00:39:40.710565 (+ 212us) server_negotiation.cc:407] Connection header received
0807 00:39:40.710648 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 00:39:40.710683 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 00:39:40.710695 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 00:39:40.710749 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 00:39:40.710868 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.711398 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.713127 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 00:39:40.713410 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 00:39:40.713469 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 00:39:40.713992 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 00:39:40.714031 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 00:39:40.714098 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 00:39:40.714624 (+ 526us) server_negotiation.cc:299] Negotiation successful
0807 00:39:40.714717 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 00:39:40.716121 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31898
I20260807 00:39:40.723351 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 31980
I20260807 00:39:40.730365 8176 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task2dG0Jg/build/release/bin/kudu with pid 32059
2026-08-07T00:39:40Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3124 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6126 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (290672 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST